-- Logs begin at Fri 2022-06-24 08:52:39 UTC, end at Fri 2022-06-24 10:00:47 UTC. -- Jun 24 09:26:21.305247 dv-cinder-803823-13-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 09:26:21.314873 dv-cinder-803823-13-smb devstack@keystone.service[80499]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 09:26:21 2022] *** Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: nodename: dv-cinder-803823-13-smb Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: machine: x86_64 Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: clock source: unix Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: pcre jit disabled Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: detected number of CPU cores: 4 Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: current working directory: / Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: detected binary path: /usr/bin/uwsgi-core Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: your processes number limit is 47680 Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: your memory page size is 4096 bytes Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: detected max file descriptor number: 2048 Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: lock engine: pthread robust mutexes Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: thunder lock: enabled Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 09:26:21.317958 dv-cinder-803823-13-smb devstack@keystone.service[80499]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 09:26:21.362109 dv-cinder-803823-13-smb devstack@keystone.service[80499]: Python main interpreter initialized at 0x56089ec209c0 Jun 24 09:26:21.362109 dv-cinder-803823-13-smb devstack@keystone.service[80499]: python threads support enabled Jun 24 09:26:21.362109 dv-cinder-803823-13-smb devstack@keystone.service[80499]: your server socket listen backlog is limited to 100 connections Jun 24 09:26:21.362109 dv-cinder-803823-13-smb devstack@keystone.service[80499]: your mercy for graceful operations on workers is 90 seconds Jun 24 09:26:21.362435 dv-cinder-803823-13-smb devstack@keystone.service[80499]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 09:26:21.362533 dv-cinder-803823-13-smb devstack@keystone.service[80499]: *** Operational MODE: preforking *** Jun 24 09:26:21.362809 dv-cinder-803823-13-smb devstack@keystone.service[80499]: *** uWSGI is running in multiple interpreter mode *** Jun 24 09:26:21.362809 dv-cinder-803823-13-smb devstack@keystone.service[80499]: spawned uWSGI master process (pid: 80499) Jun 24 09:26:21.363039 dv-cinder-803823-13-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 24 09:26:21.364005 dv-cinder-803823-13-smb devstack@keystone.service[80499]: spawned uWSGI worker 1 (pid: 80512, cores: 1) Jun 24 09:26:21.364005 dv-cinder-803823-13-smb devstack@keystone.service[80499]: spawned uWSGI worker 2 (pid: 80513, cores: 1) Jun 24 09:26:21.364154 dv-cinder-803823-13-smb devstack@keystone.service[80499]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 09:26:26.906372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:26:26.906372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: from cryptography.utils import int_from_bytes Jun 24 09:26:26.907161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:26:26.907161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: from cryptography.utils import int_from_bytes Jun 24 09:26:26.917053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:26:26.917053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: from cryptography.utils import int_from_bytes Jun 24 09:26:26.917517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:26:26.917517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: from cryptography.utils import int_from_bytes Jun 24 09:26:26.962612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 09:26:26.962787 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 09:26:26.963005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] command line args: [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 09:26:26.963317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 09:26:26.963498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ================================================================================ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 09:26:26.963756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] admin_token = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.964002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] config_dir = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.964192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.964375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] config_source = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.964556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] debug = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.964753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.965007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 09:26:26.965133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.965216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 09:26:26.965283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.965441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] command line args: [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 09:26:26.965576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.965664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 09:26:26.965829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.965942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ================================================================================ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 09:26:26.966061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.966177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] admin_token = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.966278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_config_append = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.966379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] config_dir = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.966479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.966578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.966684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_dir = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.966777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] config_source = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.971790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_file = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.971917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] debug = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.972932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_config_append = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_dir = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_file = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973854 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.973929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] publish_errors = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.974992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975561 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] standard_threads = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.975862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_journal = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_json = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] publish_errors = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_stderr = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_syslog = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.976830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.976955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.977035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.977105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.977217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] standard_threads = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.977297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.977367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.977443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.977518 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.977593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.977668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.977738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.977811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_journal = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.977811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_json = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.977952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_stderr = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.978102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_syslog = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.978256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:26:26.978411 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978561 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.978950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.979980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980054 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980345 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.980969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.981925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.982099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.982183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.982363 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.982450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.982607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.982684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.982868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.982965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.983098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.983174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.983321 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.983426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.983555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.983657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.983793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.983899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.984035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.984137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.984281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.984469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.984558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.984674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.984760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.984831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.984956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.985030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.985170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.985258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.985409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.985489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.985642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.985724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.985876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.985953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.986111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.986187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.986348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.986431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.987364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.987501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.987501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.987647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.987846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.987923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.988080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.988165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.988316 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.988401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.988552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.988630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.988783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.988873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.989029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.989105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.989260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.989335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.989494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.989578 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.989723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.989800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.989960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.990036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.990199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.990276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.990432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.990515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.990665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.990747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.990924 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.991010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.991164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.991248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.991404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.991483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.991643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.991799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.991874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.991943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.992108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.992185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.992342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.992438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.992573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.992662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.992804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.992881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.993046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.993123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.993283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.993372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.993513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.993596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.993750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.993831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.993984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.994071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.994215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.994291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.994554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.994651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.994734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.994818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.995016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.995096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.995259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.995336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.995507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.995602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.995742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.995819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.995981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.996059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.996215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.996300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.996449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.996526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.996685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.996771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.996917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.997004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.997150 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.997234 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.997378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.997461 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.997610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.997698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.997838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.997916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.998077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.998161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.998312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.998401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.998548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.998625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.998780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.998879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.999045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.999134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.999283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.999361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.999519 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.999595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.999753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.external = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.999841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:26.999983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.000060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.000217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.000295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.000451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.000537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.000689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.000768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.password = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.000922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.000999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.token = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.001156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.001240 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.001389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.001468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.001637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.001715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.001874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.001962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.002118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.002239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.002390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.002620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.002870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.003026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.003125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.003283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.003363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.003524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.external = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.003608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.003770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.003856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.004058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.004136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.004292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.004370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.004524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.password = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.004609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.004788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.token = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.004875 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.005041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.005132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.005276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.005427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.005527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.005666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.005744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.005913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.005994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.006178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.006258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.006423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.006509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.006670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.006747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.006935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.007018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.007175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.007253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.007431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.007508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.011970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012903 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.012972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013042 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.013996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014512 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.014975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015911 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.015981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016856 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.016946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.017109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.017189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.017361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.017446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.017594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.017674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.017854 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.017932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.018094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.018332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.018569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.018653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.018811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.018939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.019110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.019189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.019348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.019426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.019590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.019668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.019835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.019914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.020065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.020142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.020297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.020375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.020537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.020615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.020783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.020861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.021018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.021096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.021256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.021335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.021492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.021569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.021723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.021808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.021956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.022034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.022196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.022274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.022429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.022547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.022663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.022742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.022921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.023003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.023166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.023244 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.023404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.023485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.023641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.023720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.023872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.023949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.024107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.024187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.024343 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.024421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.024571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.024647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.024815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.024894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.025060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.025137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.025297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.025375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.025534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.025614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.025771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.025849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.026003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.026089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.026245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.026322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.026482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.026559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.026718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.026803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.026977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.027057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.027212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.027291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.027455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.027546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.027703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.027782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.027950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.028027 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.028187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.028342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.028419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.028489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.028751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.028847 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.028920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.029002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.029164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.029243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.029413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.029492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.029669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.029756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.029914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.029999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.030148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.030227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.030378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.030463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.030614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.030692 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.030865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.030946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.031114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.031203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.031352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.031430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.031589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.031667 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.031836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.031922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.032068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.032145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.032309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.032386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.032542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.032626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.032781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.032859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.033016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] role.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.033094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.033251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.033381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] role.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.033991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.034071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.034242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.034490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.034724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.034811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.034996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.035075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.035245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.035324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.035489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.035578 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.035732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.035810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.035974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.036050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.036207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.036348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.036485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.036564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.036733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.036812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.036979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.037066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.037225 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.037311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.037462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.037622 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.037722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.037864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.037964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.038117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.038195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.038367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.038454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] role.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.038617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.038696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] role.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.038887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.038969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.039126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.039217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.039380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.039459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.039630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.039709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.039869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.039955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.040102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.040181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.040336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.040414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.040570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.040657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.040821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.040900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.041075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.041152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.041319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.041404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.041556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.041635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.041791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.041868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.042023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.042109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.042259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.042419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.042497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.042658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.042736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.042938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.043023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.043192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.043271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.043443 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.043522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.043677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.043763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.043917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.043994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.044155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.044233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.044404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.044484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.044640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.044718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.044871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.044948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.045108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.045194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.045344 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.045422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.045592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.045678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.045824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.045903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.046068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.046146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.046304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.046391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.046542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.046620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.046776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.046882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.047038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.047117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.047277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.047367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.047534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.047613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.047771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.047849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.048003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.048089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.048238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.048316 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.048472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.048550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.048715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.048801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.048950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.049030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.049245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.049993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.050210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.050415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.050543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.050656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.050736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.050927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.051009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.051147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.051223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.051390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.051469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.051696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.051769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.051887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 09:26:27.051958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.052234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.052499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.052748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.052999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.053241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.053485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.053723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.053962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.054200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.054436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.054682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.054948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.055198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.055435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.055685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.055923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.056169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.056401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.056641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.056875 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:26:27.057046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 09:26:27.082769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.083013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.083237 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.084315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.084546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.084778 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.091901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.098137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.126300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.126510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.126662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.126864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.271738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.273470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.320541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.320758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.320914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.321064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.385205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.385434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.385577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.385726 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.385876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.386008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.386138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.386268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.386394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.386520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.386657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.386785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.420313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.420553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.420688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.420838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.420969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.421098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.421226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.421351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.421487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.421615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.421740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.421872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.422014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.422014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.435832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.436433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.448635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.448943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.449113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.449290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.449375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.449549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.449629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.449768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.449984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.450075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.450197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.450354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.450436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.450679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 09:26:27.476708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.476914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 09:26:27.477080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.477252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.477422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 09:26:27.477522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 09:26:27.477702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.477925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.478008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.478193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.478274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 09:26:27.478445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.478639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.478992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.479312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.479683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.489536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.489803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.490068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.490347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.491030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.491372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.491705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.492049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.498622 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.500509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.501957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.503005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.503195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.503474 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.503754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.504005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.504266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.504531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.504755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.504883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.505028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.505172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.505304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.505435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.505566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.505824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.506084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.506353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.506624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.506918 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.507191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.507455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.532487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.534185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.534461 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.534794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.536428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.536709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.539709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.540098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.540374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.541967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.542357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.542644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.547738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.548019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.550031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.550311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.557534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.557534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.557534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.557534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.557534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.557534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.558021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.558021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.558160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.558160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.558160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.558160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.558160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.558160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.558538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.558538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.574424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.574722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.576192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.576473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.579562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.581433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.583521 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.583921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.585139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.585550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.588969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.590703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.593043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.594339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.596773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.597068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.597345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.597618 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.597888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.598160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.598563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.598886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.599176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.599490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.599770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.600049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.618355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.618631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.618917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.619187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.619940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.620223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.620491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.620765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.627622 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.628710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.629315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.629588 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.630415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.630690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.632781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.633097 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.633385 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.633693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.634096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.634203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.634397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.634704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.635039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.635335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.647498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.647773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.648058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.648333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.648655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.648936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.649221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.649501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.649961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.650251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.650546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.651198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.651492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.651792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.669581 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.670211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.672863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.673527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.676855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.677446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.678600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.679206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.680324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.680600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.680839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.680924 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.681128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.681410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.688245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.688788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.689925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.690482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.693278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.693560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.693782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.693993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.708993 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.709130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.709216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.709216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.709341 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.709341 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.709489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.709566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.709627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.709627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.712022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.712299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.712575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.712859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.713128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.713506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.713810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.714177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.714307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 09:26:27.714458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.714587 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.714729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.714895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.715024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.715174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.715296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.715450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.715571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.715832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.715914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.716105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.716382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.716655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.716936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.717207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.717484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.717771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.718033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 09:26:27.756022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56089ec209c0 pid: 80513 (default app) Jun 24 09:26:27.758519 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56089ec209c0 pid: 80512 (default app) Jun 24 09:26:27.759441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe94cb8-d824-425b-a214-d309ccf215e2 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:27.759742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe94cb8-d824-425b-a214-d309ccf215e2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:27.760021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe94cb8-d824-425b-a214-d309ccf215e2 None None] PATH_INFO: `/v3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:27.764168 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Fri Jun 24 09:26:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:36.550279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d501e-6fd3-448b-bd39-0342cca4301e None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:36.550810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d501e-6fd3-448b-bd39-0342cca4301e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:36.550918 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d501e-6fd3-448b-bd39-0342cca4301e None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:36.555261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:36.560614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:36.561001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:36.561179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:36.632071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: INFO dbcounter [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] Registered counter for database keystone Jun 24 09:26:36.653370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG oslo_db.sqlalchemy.engines [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:26:36.660499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writer thread running {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:26:36.842480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG passlib.handlers.bcrypt [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80513) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 09:26:36.842819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG passlib.handlers.bcrypt [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80513) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 09:26:36.898533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:36.900164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:37.021533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 09:26:37.180947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d501e-6fd3-448b-bd39-0342cca4301e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:37.251572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: INFO dbcounter [None req-114d501e-6fd3-448b-bd39-0342cca4301e None None] Registered counter for database keystone Jun 24 09:26:37.271971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG oslo_db.sqlalchemy.engines [None req-114d501e-6fd3-448b-bd39-0342cca4301e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:26:37.278080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writer thread running {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:26:37.397639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d501e-6fd3-448b-bd39-0342cca4301e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:37.401907 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d764845-1039-4186-b9d7-2691640c8cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:37.402567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d764845-1039-4186-b9d7-2691640c8cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:37.402864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d764845-1039-4186-b9d7-2691640c8cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:37.403157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d764845-1039-4186-b9d7-2691640c8cb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:37.412097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d764845-1039-4186-b9d7-2691640c8cb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:37.465783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d764845-1039-4186-b9d7-2691640c8cb5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 09:26:37.466114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d764845-1039-4186-b9d7-2691640c8cb5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:37.476301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Jun 24 09:26:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 09:26:37.482371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:37.497473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75e38-3ff8-47d3-bed7-27dfce4cb6bb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:37.501870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012efc6-71de-403b-9768-6b32b2970f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:37.503238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012efc6-71de-403b-9768-6b32b2970f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:37.503530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012efc6-71de-403b-9768-6b32b2970f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:37.503810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012efc6-71de-403b-9768-6b32b2970f49 admin admin] PATH_INFO: `/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:37.507889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012efc6-71de-403b-9768-6b32b2970f49 admin admin] RBAC: Authorizing `identity:get_project(project_id=ecfbe47b81cd4fe29763116c4e6fcb19)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:37.559063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6012efc6-71de-403b-9768-6b32b2970f49 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 09:26:37.559414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012efc6-71de-403b-9768-6b32b2970f49 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:37.564041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Fri Jun 24 09:26:37 2022] GET /identity/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:39.574505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219cb60-c660-4732-8c6a-e90a502514a7 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:39.575028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219cb60-c660-4732-8c6a-e90a502514a7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:39.575110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219cb60-c660-4732-8c6a-e90a502514a7 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:39.579200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:26:39.585491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40352a-3302-4bab-b6be-72e98216babb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:39.585907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40352a-3302-4bab-b6be-72e98216babb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:39.586053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40352a-3302-4bab-b6be-72e98216babb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:39.604919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ab40352a-3302-4bab-b6be-72e98216babb None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:39.606699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ab40352a-3302-4bab-b6be-72e98216babb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:39.614955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 24 09:26:39.636945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219cb60-c660-4732-8c6a-e90a502514a7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:39.649877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219cb60-c660-4732-8c6a-e90a502514a7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:39.654004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3190254a-9e72-46d8-af5d-fa16c9c3b650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:39.654637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190254a-9e72-46d8-af5d-fa16c9c3b650 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:39.654952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190254a-9e72-46d8-af5d-fa16c9c3b650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:39.655233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3190254a-9e72-46d8-af5d-fa16c9c3b650 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:39.663964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190254a-9e72-46d8-af5d-fa16c9c3b650 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:39.665812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3190254a-9e72-46d8-af5d-fa16c9c3b650 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:39.674919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Jun 24 09:26:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:26:39.680427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40352a-3302-4bab-b6be-72e98216babb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:39.689462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40352a-3302-4bab-b6be-72e98216babb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:39.694616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b9604-1621-4b89-9c0d-249c9768fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:39.695513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9604-1621-4b89-9c0d-249c9768fe2b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:39.695798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9604-1621-4b89-9c0d-249c9768fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:39.696281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9604-1621-4b89-9c0d-249c9768fe2b admin admin] PATH_INFO: `/v3/users/f8e5b4d849064820a77929db188df50b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:39.697741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b9604-1621-4b89-9c0d-249c9768fe2b admin admin] RBAC: Authorizing `identity:get_user(user_id=f8e5b4d849064820a77929db188df50b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:39.699635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b9604-1621-4b89-9c0d-249c9768fe2b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:39.701206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Fri Jun 24 09:26:39 2022] GET /identity/v3/users/f8e5b4d849064820a77929db188df50b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:41.771055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1862430-97db-4bfa-bddc-31de68453b5f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:41.771562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1862430-97db-4bfa-bddc-31de68453b5f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:41.771643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1862430-97db-4bfa-bddc-31de68453b5f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:41.773157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:41.778025 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10773add-57ac-4a0d-bcba-0508434591c2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:41.778405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10773add-57ac-4a0d-bcba-0508434591c2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:41.778727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10773add-57ac-4a0d-bcba-0508434591c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:41.795212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-10773add-57ac-4a0d-bcba-0508434591c2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:41.796390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-10773add-57ac-4a0d-bcba-0508434591c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:41.814577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb40de-3468-42c4-8a7f-c5df41296a11 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:41.815531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb40de-3468-42c4-8a7f-c5df41296a11 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:41.815754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb40de-3468-42c4-8a7f-c5df41296a11 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:41.817233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:26:41.822464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61287e-4d0a-4dd0-a9a4-2e1b72f4be9e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:41.822763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61287e-4d0a-4dd0-a9a4-2e1b72f4be9e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:41.823084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61287e-4d0a-4dd0-a9a4-2e1b72f4be9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:41.863725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG passlib.handlers.bcrypt [None req-2d61287e-4d0a-4dd0-a9a4-2e1b72f4be9e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80512) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 09:26:41.864072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG passlib.handlers.bcrypt [None req-2d61287e-4d0a-4dd0-a9a4-2e1b72f4be9e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80512) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 09:26:41.878470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:26:41.906034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10773add-57ac-4a0d-bcba-0508434591c2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:41.910224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2d61287e-4d0a-4dd0-a9a4-2e1b72f4be9e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:41.911838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2d61287e-4d0a-4dd0-a9a4-2e1b72f4be9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:41.930290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:42.010758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10773add-57ac-4a0d-bcba-0508434591c2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:42.011282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:26:42.034433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61287e-4d0a-4dd0-a9a4-2e1b72f4be9e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:42.044600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12780c-f412-4b11-88ff-620145d80e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:42.045402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12780c-f412-4b11-88ff-620145d80e43 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:42.045697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12780c-f412-4b11-88ff-620145d80e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:42.045979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12780c-f412-4b11-88ff-620145d80e43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:42.057029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12780c-f412-4b11-88ff-620145d80e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-2d12780c-f412-4b11-88ff-620145d80e43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:26:42.068861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:26:42.070000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:26:42.070778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:26:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:26:42.075669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12780c-f412-4b11-88ff-620145d80e43 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:42.133994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61287e-4d0a-4dd0-a9a4-2e1b72f4be9e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:42.136713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:42.159559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:42.173781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7fd55-bc7a-485c-973d-ea313b7f1e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:42.174789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7fd55-bc7a-485c-973d-ea313b7f1e5d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:42.175116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7fd55-bc7a-485c-973d-ea313b7f1e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:42.175397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7fd55-bc7a-485c-973d-ea313b7f1e5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:42.177175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12780c-f412-4b11-88ff-620145d80e43 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:42.210778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24050ac-dd4c-47c7-8450-2ba66d720272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:42.211463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24050ac-dd4c-47c7-8450-2ba66d720272 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:42.211745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24050ac-dd4c-47c7-8450-2ba66d720272 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:42.212020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24050ac-dd4c-47c7-8450-2ba66d720272 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:42.212771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24050ac-dd4c-47c7-8450-2ba66d720272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:42.213076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24050ac-dd4c-47c7-8450-2ba66d720272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:42.214484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24050ac-dd4c-47c7-8450-2ba66d720272 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:42.228155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:26:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:26:42.233777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24050ac-dd4c-47c7-8450-2ba66d720272 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:42.243293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7fd55-bc7a-485c-973d-ea313b7f1e5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:42.244840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d7fd55-bc7a-485c-973d-ea313b7f1e5d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:42.332524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24050ac-dd4c-47c7-8450-2ba66d720272 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:42.351628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:42.357639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7fd55-bc7a-485c-973d-ea313b7f1e5d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:42.360582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:42.368345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241acd75-c835-4a53-a44b-237b28df7dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:42.371572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241acd75-c835-4a53-a44b-237b28df7dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:42.371572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241acd75-c835-4a53-a44b-237b28df7dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:42.371572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241acd75-c835-4a53-a44b-237b28df7dd2 None admin] PATH_INFO: `/v3/users/f8e5b4d849064820a77929db188df50b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:42.371572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241acd75-c835-4a53-a44b-237b28df7dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=f8e5b4d849064820a77929db188df50b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:42.372406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241acd75-c835-4a53-a44b-237b28df7dd2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:42.374065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:26:42 2022] GET /identity/v3/users/f8e5b4d849064820a77929db188df50b => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:26:42.380092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241acd75-c835-4a53-a44b-237b28df7dd2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:42.394698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:42.456417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7fd55-bc7a-485c-973d-ea313b7f1e5d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:42.482178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241acd75-c835-4a53-a44b-237b28df7dd2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:42.490745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e73f1-93e9-46c1-83f9-6ee7fb25cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:42.491568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e73f1-93e9-46c1-83f9-6ee7fb25cc50 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:42.491851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e73f1-93e9-46c1-83f9-6ee7fb25cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:42.492128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e73f1-93e9-46c1-83f9-6ee7fb25cc50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:42.512190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e73f1-93e9-46c1-83f9-6ee7fb25cc50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:42.513646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e73f1-93e9-46c1-83f9-6ee7fb25cc50 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:42.515250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa27860-6a86-4669-bb92-e1ff9947f595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:42.516038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa27860-6a86-4669-bb92-e1ff9947f595 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:42.516326 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa27860-6a86-4669-bb92-e1ff9947f595 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:42.516603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa27860-6a86-4669-bb92-e1ff9947f595 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:42.517817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa27860-6a86-4669-bb92-e1ff9947f595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:42.519963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa27860-6a86-4669-bb92-e1ff9947f595 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:42.521739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:26:42.527244 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa27860-6a86-4669-bb92-e1ff9947f595 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-796e73f1-93e9-46c1-83f9-6ee7fb25cc50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:26:42.535628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:26:42.536411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:26:42.537208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:26:42.537208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:26:42.537208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:26:42.537208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:26:42.537208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:26:42.542501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e73f1-93e9-46c1-83f9-6ee7fb25cc50 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:42.604493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:42.608145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:42.626952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa27860-6a86-4669-bb92-e1ff9947f595 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:42.683132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e73f1-93e9-46c1-83f9-6ee7fb25cc50 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:42.683354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c2abb-9b1d-4e7b-b1da-1f68a194223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:42.683354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c2abb-9b1d-4e7b-b1da-1f68a194223c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:42.683354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c2abb-9b1d-4e7b-b1da-1f68a194223c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:42.683354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c2abb-9b1d-4e7b-b1da-1f68a194223c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:42.683688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c2abb-9b1d-4e7b-b1da-1f68a194223c None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.domain.id=default, user.id=f8e5b4d849064820a77929db188df50b) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:42.683688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c2abb-9b1d-4e7b-b1da-1f68a194223c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:42.683688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c2abb-9b1d-4e7b-b1da-1f68a194223c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:42.683688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Jun 24 09:26:42 2022] GET /identity/v3/role_assignments?user.id=f8e5b4d849064820a77929db188df50b&scope.domain.id=default&role.id=9312183c32b04118985c8316f33f3830 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:26:42.684704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2294c-f68f-4cf9-83e2-7a81ac7c783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:42.685381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2294c-f68f-4cf9-83e2-7a81ac7c783b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:42.685673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2294c-f68f-4cf9-83e2-7a81ac7c783b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:42.685955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2294c-f68f-4cf9-83e2-7a81ac7c783b None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:42.686717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2294c-f68f-4cf9-83e2-7a81ac7c783b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:42.687046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2294c-f68f-4cf9-83e2-7a81ac7c783b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:42.688496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2294c-f68f-4cf9-83e2-7a81ac7c783b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:42.710119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:26:45.024232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ce1a-13a3-4b79-9242-efc154e02b3b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.025246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ce1a-13a3-4b79-9242-efc154e02b3b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.025748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ce1a-13a3-4b79-9242-efc154e02b3b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.027361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:45.033097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0fe9f-4e9d-4209-8426-25e16282c4f5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.034559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0fe9f-4e9d-4209-8426-25e16282c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.035075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0fe9f-4e9d-4209-8426-25e16282c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.052984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-16c0fe9f-4e9d-4209-8426-25e16282c4f5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:45.054486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-16c0fe9f-4e9d-4209-8426-25e16282c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:45.112135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0304-d0a3-428c-befa-d60dd51ad6d3 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.113509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0304-d0a3-428c-befa-d60dd51ad6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.113994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a0304-d0a3-428c-befa-d60dd51ad6d3 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.115905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 13/23] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:45.124292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075397c5-e924-418a-a1a6-416c668aacd1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.124896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075397c5-e924-418a-a1a6-416c668aacd1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.125437 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075397c5-e924-418a-a1a6-416c668aacd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.149952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:45.150926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-075397c5-e924-418a-a1a6-416c668aacd1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:45.152151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-075397c5-e924-418a-a1a6-416c668aacd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:45.196408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0fe9f-4e9d-4209-8426-25e16282c4f5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:45.290716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:45.294694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 14/25] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:45.329835 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075397c5-e924-418a-a1a6-416c668aacd1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:45.378313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0fe9f-4e9d-4209-8426-25e16282c4f5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:45.447169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639135f5-2342-4cf3-a016-8da845f4982e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:45.447979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639135f5-2342-4cf3-a016-8da845f4982e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.448268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639135f5-2342-4cf3-a016-8da845f4982e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.448548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639135f5-2342-4cf3-a016-8da845f4982e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.464897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:45.473717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639135f5-2342-4cf3-a016-8da845f4982e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-639135f5-2342-4cf3-a016-8da845f4982e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:26:45.492463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:26:45.493467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:26:45.494716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 12/26] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:26:45.497648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8f9cd-0a11-4219-9f59-8280b12df938 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.498809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8f9cd-0a11-4219-9f59-8280b12df938 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.499933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8f9cd-0a11-4219-9f59-8280b12df938 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.503647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:45.504665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8f9cd-0a11-4219-9f59-8280b12df938 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:45.517365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075397c5-e924-418a-a1a6-416c668aacd1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:45.607007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00085b2a-db6f-4a7c-bbcb-efbb9e82cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:45.608011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00085b2a-db6f-4a7c-bbcb-efbb9e82cc4c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.608505 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00085b2a-db6f-4a7c-bbcb-efbb9e82cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.609000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00085b2a-db6f-4a7c-bbcb-efbb9e82cc4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.618047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8f9cd-0a11-4219-9f59-8280b12df938 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:45.625790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:45.634967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00085b2a-db6f-4a7c-bbcb-efbb9e82cc4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:45.636770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00085b2a-db6f-4a7c-bbcb-efbb9e82cc4c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:45.655713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629a57-effa-4c65-b8e8-6c9b8c3c45a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:45.656687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629a57-effa-4c65-b8e8-6c9b8c3c45a6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.657160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629a57-effa-4c65-b8e8-6c9b8c3c45a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.657593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9629a57-effa-4c65-b8e8-6c9b8c3c45a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.658927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9629a57-effa-4c65-b8e8-6c9b8c3c45a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:45.659465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9629a57-effa-4c65-b8e8-6c9b8c3c45a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:45.661055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9629a57-effa-4c65-b8e8-6c9b8c3c45a6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-00085b2a-db6f-4a7c-bbcb-efbb9e82cc4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:26:45.670770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:26:45.671813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:26:45.672807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:26:45.672807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:26:45.672807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:26:45.672807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:26:45.676285 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 15/28] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:26:45.678626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 14/29] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:45.680154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b7de5-8201-4151-b679-73622dadfde6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.680713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b7de5-8201-4151-b679-73622dadfde6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.681205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b7de5-8201-4151-b679-73622dadfde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.684196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629a57-effa-4c65-b8e8-6c9b8c3c45a6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:45.718290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-af2b7de5-8201-4151-b679-73622dadfde6 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:45.721314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-af2b7de5-8201-4151-b679-73622dadfde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:45.833358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 16/30] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:45.834209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b7de5-8201-4151-b679-73622dadfde6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:45.848331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9629a57-effa-4c65-b8e8-6c9b8c3c45a6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:45.888014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2bdf0-0f57-4b4a-9cb2-4989f427b353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:45.889299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2bdf0-0f57-4b4a-9cb2-4989f427b353 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.889836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2bdf0-0f57-4b4a-9cb2-4989f427b353 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.890309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2bdf0-0f57-4b4a-9cb2-4989f427b353 None admin] PATH_INFO: `/v3/users/f8e5b4d849064820a77929db188df50b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.892409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2bdf0-0f57-4b4a-9cb2-4989f427b353 None admin] RBAC: Authorizing `identity:get_user(user_id=f8e5b4d849064820a77929db188df50b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:45.894320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:45.895519 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2bdf0-0f57-4b4a-9cb2-4989f427b353 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:45.897973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 15/31] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:26:45 2022] GET /identity/v3/users/f8e5b4d849064820a77929db188df50b => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:26:45.899588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1126b-ca69-4dd8-83b6-7265ba55e885 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.900195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1126b-ca69-4dd8-83b6-7265ba55e885 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.904930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1126b-ca69-4dd8-83b6-7265ba55e885 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.906515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 16/32] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:45.913251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1126b-ca69-4dd8-83b6-7265ba55e885 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:45.949682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b7de5-8201-4151-b679-73622dadfde6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:45.975173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:45.984720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec8354-4c54-4846-94a7-2f298a383c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:45.985451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec8354-4c54-4846-94a7-2f298a383c75 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:45.985734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec8354-4c54-4846-94a7-2f298a383c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:45.986064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec8354-4c54-4846-94a7-2f298a383c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:45.987555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec8354-4c54-4846-94a7-2f298a383c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:45.991549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec8354-4c54-4846-94a7-2f298a383c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:45.991549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaec8354-4c54-4846-94a7-2f298a383c75 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:46.008447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:46.013642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec8354-4c54-4846-94a7-2f298a383c75 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:46.061275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1126b-ca69-4dd8-83b6-7265ba55e885 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:46.106406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607a16c-95ef-44c9-b52a-106f2200db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:46.107459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607a16c-95ef-44c9-b52a-106f2200db90 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.108366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607a16c-95ef-44c9-b52a-106f2200db90 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.108858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607a16c-95ef-44c9-b52a-106f2200db90 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.110104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607a16c-95ef-44c9-b52a-106f2200db90 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:46.112838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607a16c-95ef-44c9-b52a-106f2200db90 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:46.121242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec8354-4c54-4846-94a7-2f298a383c75 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:46.139131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:46.156763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367b7c-5d52-49cb-bcf4-c8a8756d9be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:46.157607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367b7c-5d52-49cb-bcf4-c8a8756d9be7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.157892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367b7c-5d52-49cb-bcf4-c8a8756d9be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.158163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367b7c-5d52-49cb-bcf4-c8a8756d9be7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.159696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63367b7c-5d52-49cb-bcf4-c8a8756d9be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:46.161276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63367b7c-5d52-49cb-bcf4-c8a8756d9be7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:46.168239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 18/34] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:26:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:46.168239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eaa04-5dc5-4333-9f6f-44ce00ce75c3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.168239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eaa04-5dc5-4333-9f6f-44ce00ce75c3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.168239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6eaa04-5dc5-4333-9f6f-44ce00ce75c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.185017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4b6eaa04-5dc5-4333-9f6f-44ce00ce75c3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:46.186201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4b6eaa04-5dc5-4333-9f6f-44ce00ce75c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:46.272737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:46.273456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eaa04-5dc5-4333-9f6f-44ce00ce75c3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:46.378588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 17/36] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 09:26:45 2022] POST /identity/v3/roles => generated 219 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:46.379403 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607a16c-95ef-44c9-b52a-106f2200db90 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:46.435063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6eaa04-5dc5-4333-9f6f-44ce00ce75c3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:46.452861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:46.476074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef798dc4-7932-4c85-9c94-5581d6218192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:46.477094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798dc4-7932-4c85-9c94-5581d6218192 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.477577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798dc4-7932-4c85-9c94-5581d6218192 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.478051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef798dc4-7932-4c85-9c94-5581d6218192 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.478993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef798dc4-7932-4c85-9c94-5581d6218192 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:46.480739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef798dc4-7932-4c85-9c94-5581d6218192 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:46.495954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:46.503860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607a16c-95ef-44c9-b52a-106f2200db90 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:46.543757 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ca510-8c72-43d2-b88d-0a582dc6b418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:46.544644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ca510-8c72-43d2-b88d-0a582dc6b418 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.544945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ca510-8c72-43d2-b88d-0a582dc6b418 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.545227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ca510-8c72-43d2-b88d-0a582dc6b418 None admin] PATH_INFO: `/v3/domains/default/users/f8e5b4d849064820a77929db188df50b/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.547604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ca510-8c72-43d2-b88d-0a582dc6b418 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f8e5b4d849064820a77929db188df50b, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:46.549564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ca510-8c72-43d2-b88d-0a582dc6b418 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:46.655122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 18/37] 10.222.0.42 () {58 vars in 1361 bytes} [Fri Jun 24 09:26:46 2022] PUT /identity/v3/domains/default/users/f8e5b4d849064820a77929db188df50b/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:46.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ca510-8c72-43d2-b88d-0a582dc6b418 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:46.727100 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 20/38] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:26:46 2022] POST /identity/v3/projects => generated 301 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:46.728692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e4556-a462-4758-ae99-7cbd92835824 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.728994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e4556-a462-4758-ae99-7cbd92835824 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.729279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e4556-a462-4758-ae99-7cbd92835824 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.734930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 21/39] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:46.734930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9967b7c-0615-4ad4-a08e-827c8acf2c2b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.734930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9967b7c-0615-4ad4-a08e-827c8acf2c2b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.734930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9967b7c-0615-4ad4-a08e-827c8acf2c2b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.734930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 22/40] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:46.745724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a040-ced3-4405-9b9a-81d29b78de73 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.745724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a040-ced3-4405-9b9a-81d29b78de73 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.745724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a040-ced3-4405-9b9a-81d29b78de73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.789696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ca510-8c72-43d2-b88d-0a582dc6b418 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:46.840861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae63717-0c69-4eae-ac7e-e6176fce0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:46.841659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63717-0c69-4eae-ac7e-e6176fce0405 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.841954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63717-0c69-4eae-ac7e-e6176fce0405 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.842240 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae63717-0c69-4eae-ac7e-e6176fce0405 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.843059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae63717-0c69-4eae-ac7e-e6176fce0405 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:46.844543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae63717-0c69-4eae-ac7e-e6176fce0405 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:46.889979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2513a040-ced3-4405-9b9a-81d29b78de73 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:46.891964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2513a040-ced3-4405-9b9a-81d29b78de73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:46.944236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 19/41] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 09:26:46 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:46.946140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08148b37-3474-4a58-bd71-4adc79dd94d1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:46.946453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08148b37-3474-4a58-bd71-4adc79dd94d1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:46.946754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08148b37-3474-4a58-bd71-4adc79dd94d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:46.969523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-08148b37-3474-4a58-bd71-4adc79dd94d1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:46.972661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-08148b37-3474-4a58-bd71-4adc79dd94d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:46.983851 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 23/42] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:47.003898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:47.007987 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a040-ced3-4405-9b9a-81d29b78de73 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:47.059428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 20/43] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:47.083933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08148b37-3474-4a58-bd71-4adc79dd94d1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:47.157610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:47.166577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a040-ced3-4405-9b9a-81d29b78de73 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:47.206665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08148b37-3474-4a58-bd71-4adc79dd94d1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:47.208370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34b3ff-74ed-429b-b7d2-d51030331711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:47.210034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34b3ff-74ed-429b-b7d2-d51030331711 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:47.210331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34b3ff-74ed-429b-b7d2-d51030331711 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:47.210615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34b3ff-74ed-429b-b7d2-d51030331711 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:47.211432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34b3ff-74ed-429b-b7d2-d51030331711 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:47.212974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34b3ff-74ed-429b-b7d2-d51030331711 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:47.242454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11b038-c818-4bde-abe7-aa633d4389c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:47.243297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11b038-c818-4bde-abe7-aa633d4389c4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:47.243586 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11b038-c818-4bde-abe7-aa633d4389c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:47.243864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11b038-c818-4bde-abe7-aa633d4389c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:47.245032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11b038-c818-4bde-abe7-aa633d4389c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:47.246539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11b038-c818-4bde-abe7-aa633d4389c4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:47.248180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 21/44] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:26:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:26:47.254195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11b038-c818-4bde-abe7-aa633d4389c4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:47.270946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:47.352573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11b038-c818-4bde-abe7-aa633d4389c4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:47.363148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 24/45] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 09:26:47 2022] POST /identity/v3/roles => generated 223 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:47.398311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72964c8-f088-4572-8fc0-c153746e7fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:47.399066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72964c8-f088-4572-8fc0-c153746e7fe7 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:47.401904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72964c8-f088-4572-8fc0-c153746e7fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:47.401904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72964c8-f088-4572-8fc0-c153746e7fe7 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:47.401904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72964c8-f088-4572-8fc0-c153746e7fe7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:47.402119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72964c8-f088-4572-8fc0-c153746e7fe7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:47.545514 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 22/46] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:26:47 2022] POST /identity/v3/projects => generated 312 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:26:48.804025 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf5ab0-aa77-4cb4-97d0-87bb4aa945d7 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:48.804549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf5ab0-aa77-4cb4-97d0-87bb4aa945d7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:48.804633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf5ab0-aa77-4cb4-97d0-87bb4aa945d7 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:48.806048 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 25/47] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:48.811324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661270d-7b82-4b6c-aef4-ac572dd7877e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:48.811745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661270d-7b82-4b6c-aef4-ac572dd7877e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:48.812038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661270d-7b82-4b6c-aef4-ac572dd7877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:48.829513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8661270d-7b82-4b6c-aef4-ac572dd7877e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:48.831400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8661270d-7b82-4b6c-aef4-ac572dd7877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:48.890610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:48.898158 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 23/48] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:48.921387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf5ab0-aa77-4cb4-97d0-87bb4aa945d7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:49.024243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf5ab0-aa77-4cb4-97d0-87bb4aa945d7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:49.057210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b63a1-491d-494b-8fd8-af690a500f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:49.058012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b63a1-491d-494b-8fd8-af690a500f27 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.058304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b63a1-491d-494b-8fd8-af690a500f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.058584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b63a1-491d-494b-8fd8-af690a500f27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.069686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b63a1-491d-494b-8fd8-af690a500f27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-876b63a1-491d-494b-8fd8-af690a500f27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:26:49.077329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:26:49.078279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:26:49.079049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 26/49] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:26:49.084265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661270d-7b82-4b6c-aef4-ac572dd7877e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:49.182192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661270d-7b82-4b6c-aef4-ac572dd7877e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:49.216681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508d3f9-9d71-4ee3-b5e0-5a0b6559bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:49.217358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508d3f9-9d71-4ee3-b5e0-5a0b6559bbec None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.217651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508d3f9-9d71-4ee3-b5e0-5a0b6559bbec None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.217954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508d3f9-9d71-4ee3-b5e0-5a0b6559bbec None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.218712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508d3f9-9d71-4ee3-b5e0-5a0b6559bbec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:49.219065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508d3f9-9d71-4ee3-b5e0-5a0b6559bbec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:49.220485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508d3f9-9d71-4ee3-b5e0-5a0b6559bbec None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:49.229408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 24/50] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:49.235023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b63a1-491d-494b-8fd8-af690a500f27 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:49.254468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:49.335757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b63a1-491d-494b-8fd8-af690a500f27 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:49.370149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bd0ee-e247-4c66-bfdf-186bb11ecf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:49.371059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd0ee-e247-4c66-bfdf-186bb11ecf39 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.371348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd0ee-e247-4c66-bfdf-186bb11ecf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.371628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bd0ee-e247-4c66-bfdf-186bb11ecf39 None admin] PATH_INFO: `/v3/users/f8e5b4d849064820a77929db188df50b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.372825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bd0ee-e247-4c66-bfdf-186bb11ecf39 None admin] RBAC: Authorizing `identity:get_user(user_id=f8e5b4d849064820a77929db188df50b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:49.374298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bd0ee-e247-4c66-bfdf-186bb11ecf39 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:49.375973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 27/51] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:26:49 2022] GET /identity/v3/users/f8e5b4d849064820a77929db188df50b => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:49.381651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508d3f9-9d71-4ee3-b5e0-5a0b6559bbec None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:49.545084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:49.560580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cfb43-712d-456d-8c0c-af352daec059 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.560868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cfb43-712d-456d-8c0c-af352daec059 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.561150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cfb43-712d-456d-8c0c-af352daec059 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.562658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 28/52] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:26:49.567403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53cad-a61e-42ee-854d-c9ae7bcb464e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.567700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53cad-a61e-42ee-854d-c9ae7bcb464e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.567987 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab53cad-a61e-42ee-854d-c9ae7bcb464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.585143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-eab53cad-a61e-42ee-854d-c9ae7bcb464e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:49.586342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-eab53cad-a61e-42ee-854d-c9ae7bcb464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:49.591151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508d3f9-9d71-4ee3-b5e0-5a0b6559bbec None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:49.626004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775472e-b8dc-4a4d-b49d-7530b47f98f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:49.626809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775472e-b8dc-4a4d-b49d-7530b47f98f0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.627177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775472e-b8dc-4a4d-b49d-7530b47f98f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.627890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775472e-b8dc-4a4d-b49d-7530b47f98f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.629078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775472e-b8dc-4a4d-b49d-7530b47f98f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:49.630533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775472e-b8dc-4a4d-b49d-7530b47f98f0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:49.632224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 25/53] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:49.637942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775472e-b8dc-4a4d-b49d-7530b47f98f0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:49.655687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 29/54] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:26:49.679657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab53cad-a61e-42ee-854d-c9ae7bcb464e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:49.696053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:49.742177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775472e-b8dc-4a4d-b49d-7530b47f98f0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:49.767507 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:49.777216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f11ff-7e88-4d32-bdd8-14063f7b968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:49.777885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f11ff-7e88-4d32-bdd8-14063f7b968c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.778165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f11ff-7e88-4d32-bdd8-14063f7b968c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.778444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f11ff-7e88-4d32-bdd8-14063f7b968c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.781391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f11ff-7e88-4d32-bdd8-14063f7b968c None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.domain.id=default, user.id=f8e5b4d849064820a77929db188df50b) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:49.781391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f11ff-7e88-4d32-bdd8-14063f7b968c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:49.781567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab53cad-a61e-42ee-854d-c9ae7bcb464e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:49.781658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f11ff-7e88-4d32-bdd8-14063f7b968c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:49.791171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 26/55] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Jun 24 09:26:49 2022] GET /identity/v3/role_assignments?user.id=f8e5b4d849064820a77929db188df50b&scope.domain.id=default&role.id=9312183c32b04118985c8316f33f3830 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:26:49.818545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241735f4-ab1e-4810-9dad-f2d7bf4c2a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:49.819329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241735f4-ab1e-4810-9dad-f2d7bf4c2a0e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.819616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241735f4-ab1e-4810-9dad-f2d7bf4c2a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.819895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241735f4-ab1e-4810-9dad-f2d7bf4c2a0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.821138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241735f4-ab1e-4810-9dad-f2d7bf4c2a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:49.822681 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241735f4-ab1e-4810-9dad-f2d7bf4c2a0e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:49.824471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 30/56] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:26:49.831004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f11ff-7e88-4d32-bdd8-14063f7b968c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:49.939535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f11ff-7e88-4d32-bdd8-14063f7b968c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:49.975644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeda0c8-ed90-4fe1-8b22-cf113d582f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:49.976324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeda0c8-ed90-4fe1-8b22-cf113d582f90 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.976616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeda0c8-ed90-4fe1-8b22-cf113d582f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeda0c8-ed90-4fe1-8b22-cf113d582f90 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.977628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeda0c8-ed90-4fe1-8b22-cf113d582f90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:49.979129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeda0c8-ed90-4fe1-8b22-cf113d582f90 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:50.128933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 27/57] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Jun 24 09:26:49 2022] POST /identity/v3/projects => generated 298 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:52.187952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0993534-f8ad-4eab-841a-d50218967cdd None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.188469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0993534-f8ad-4eab-841a-d50218967cdd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.188551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0993534-f8ad-4eab-841a-d50218967cdd None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.190528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 31/58] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:52.195758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eb4f3-bcba-4c4d-9c8d-923d850b1a61 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.196166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eb4f3-bcba-4c4d-9c8d-923d850b1a61 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.196336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eb4f3-bcba-4c4d-9c8d-923d850b1a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.212721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3b5eb4f3-bcba-4c4d-9c8d-923d850b1a61 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:52.213911 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3b5eb4f3-bcba-4c4d-9c8d-923d850b1a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:52.248694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:52.277886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:52.307257 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0993534-f8ad-4eab-841a-d50218967cdd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:52.388088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:52.406401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0993534-f8ad-4eab-841a-d50218967cdd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:52.440916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62646a1-0a12-410d-9668-f37ce58aa8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:52.441684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62646a1-0a12-410d-9668-f37ce58aa8ef None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.441966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62646a1-0a12-410d-9668-f37ce58aa8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.442239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62646a1-0a12-410d-9668-f37ce58aa8ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.443431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62646a1-0a12-410d-9668-f37ce58aa8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:52.444872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62646a1-0a12-410d-9668-f37ce58aa8ef None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:52.446475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 32/60] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:26:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:52.451872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eb4f3-bcba-4c4d-9c8d-923d850b1a61 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:52.547224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eb4f3-bcba-4c4d-9c8d-923d850b1a61 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:52.580800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648af054-7f58-4e98-bc6f-5c9f7c6bb839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:52.581474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af054-7f58-4e98-bc6f-5c9f7c6bb839 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.581771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af054-7f58-4e98-bc6f-5c9f7c6bb839 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.582056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648af054-7f58-4e98-bc6f-5c9f7c6bb839 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.582776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af054-7f58-4e98-bc6f-5c9f7c6bb839 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:52.584273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648af054-7f58-4e98-bc6f-5c9f7c6bb839 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:52.669364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 29/61] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:26:52 2022] POST /identity/v3/users => generated 275 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:26:55.852289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb317e-8ccf-4cff-8748-1e45a021100a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:55.852289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb317e-8ccf-4cff-8748-1e45a021100a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:55.852289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb317e-8ccf-4cff-8748-1e45a021100a None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:55.853370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 33/62] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:55.857638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1cda1-520e-4011-b9a0-35be25f469d4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:55.858407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1cda1-520e-4011-b9a0-35be25f469d4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:55.858917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1cda1-520e-4011-b9a0-35be25f469d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:55.881670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b3f1cda1-520e-4011-b9a0-35be25f469d4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:55.883192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b3f1cda1-520e-4011-b9a0-35be25f469d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:55.921627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:55.937100 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885edf8-fd26-43cf-8496-3e016fc07035 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:55.937764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885edf8-fd26-43cf-8496-3e016fc07035 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:55.938300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885edf8-fd26-43cf-8496-3e016fc07035 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:55.940428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 34/63] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:26:55.953439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a822eb-bfdb-46cd-9d90-24b234983282 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:55.953733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a822eb-bfdb-46cd-9d90-24b234983282 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:55.954023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a822eb-bfdb-46cd-9d90-24b234983282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:55.980631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b2a822eb-bfdb-46cd-9d90-24b234983282 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:55.982115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b2a822eb-bfdb-46cd-9d90-24b234983282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:55.998069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 30/64] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:56.023139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1cda1-520e-4011-b9a0-35be25f469d4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.117773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 35/65] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:26:56.141635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ac9b6-5772-401c-b0b8-504dfb17f727 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.142256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ac9b6-5772-401c-b0b8-504dfb17f727 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.142735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ac9b6-5772-401c-b0b8-504dfb17f727 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.145698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 36/66] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:26:56.150593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ac9b6-5772-401c-b0b8-504dfb17f727 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.174696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1cda1-520e-4011-b9a0-35be25f469d4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.214750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee708f14-408d-4075-8e60-853f0158ad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.215840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708f14-408d-4075-8e60-853f0158ad41 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.216271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708f14-408d-4075-8e60-853f0158ad41 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.216733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee708f14-408d-4075-8e60-853f0158ad41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.227434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee708f14-408d-4075-8e60-853f0158ad41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ee708f14-408d-4075-8e60-853f0158ad41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:26:56.235637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:26:56.236490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:26:56.237277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:26:56.239633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 31/67] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:26:56.241186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131653d7-006a-4d92-89c8-5d51961462a0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.241654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131653d7-006a-4d92-89c8-5d51961462a0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.242105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131653d7-006a-4d92-89c8-5d51961462a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.245146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:56.260520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-131653d7-006a-4d92-89c8-5d51961462a0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:56.261962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-131653d7-006a-4d92-89c8-5d51961462a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:56.270341 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ac9b6-5772-401c-b0b8-504dfb17f727 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.277575 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:56.315603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93466e1b-80f8-4dd2-b3bb-4e51186408df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.316547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93466e1b-80f8-4dd2-b3bb-4e51186408df None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.316839 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93466e1b-80f8-4dd2-b3bb-4e51186408df None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.317114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93466e1b-80f8-4dd2-b3bb-4e51186408df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.327443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93466e1b-80f8-4dd2-b3bb-4e51186408df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-93466e1b-80f8-4dd2-b3bb-4e51186408df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:26:56.335886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:26:56.336751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:26:56.337507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:26:56.338068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 32/68] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:56.338068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131653d7-006a-4d92-89c8-5d51961462a0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.343520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 37/69] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:26:56.345062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd7726-a2dc-44d6-9bfa-0a87ca92ffed None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.345694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd7726-a2dc-44d6-9bfa-0a87ca92ffed None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.346232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd7726-a2dc-44d6-9bfa-0a87ca92ffed None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.351738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 38/70] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:56.352531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd7726-a2dc-44d6-9bfa-0a87ca92ffed None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.446409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131653d7-006a-4d92-89c8-5d51961462a0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.464784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd7726-a2dc-44d6-9bfa-0a87ca92ffed None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.478887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35861436-63ae-494b-81ac-053b7cd4d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.479564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861436-63ae-494b-81ac-053b7cd4d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.479851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861436-63ae-494b-81ac-053b7cd4d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.480129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35861436-63ae-494b-81ac-053b7cd4d1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.480874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35861436-63ae-494b-81ac-053b7cd4d1e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:56.481181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35861436-63ae-494b-81ac-053b7cd4d1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:56.482820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35861436-63ae-494b-81ac-053b7cd4d1e2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:56.491209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 33/71] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:56.495823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc707bbc-73dc-4325-8b93-35d0b198d7d2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.495823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc707bbc-73dc-4325-8b93-35d0b198d7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.495823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc707bbc-73dc-4325-8b93-35d0b198d7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.499118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d8ee5-ffcb-4467-a3ca-ba45b47f70b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.499829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d8ee5-ffcb-4467-a3ca-ba45b47f70b7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.500121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d8ee5-ffcb-4467-a3ca-ba45b47f70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.500407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d8ee5-ffcb-4467-a3ca-ba45b47f70b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.501167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d8ee5-ffcb-4467-a3ca-ba45b47f70b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:56.501484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d8ee5-ffcb-4467-a3ca-ba45b47f70b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:56.503628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d8ee5-ffcb-4467-a3ca-ba45b47f70b7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:56.508983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cc707bbc-73dc-4325-8b93-35d0b198d7d2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:56.510163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cc707bbc-73dc-4325-8b93-35d0b198d7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:56.512307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 39/72] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:56.512865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:56.514243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d8ee5-ffcb-4467-a3ca-ba45b47f70b7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.516940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:56.574485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 34/73] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:56.576137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03aa4-ba8c-4679-b5cf-7b64cc8d8b5b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.576435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03aa4-ba8c-4679-b5cf-7b64cc8d8b5b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.576722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af03aa4-ba8c-4679-b5cf-7b64cc8d8b5b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.578213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 35/74] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:26:56.583718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03aa4-ba8c-4679-b5cf-7b64cc8d8b5b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.616744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d8ee5-ffcb-4467-a3ca-ba45b47f70b7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.651446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbcfab-3e5b-47cc-afd5-36a324f26d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.652255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbcfab-3e5b-47cc-afd5-36a324f26d20 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.652538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbcfab-3e5b-47cc-afd5-36a324f26d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.652820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbcfab-3e5b-47cc-afd5-36a324f26d20 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.662753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbcfab-3e5b-47cc-afd5-36a324f26d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f1cbcfab-3e5b-47cc-afd5-36a324f26d20 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:26:56.670786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:26:56.671786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:26:56.672524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 40/75] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:26:56.673153 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbcfab-3e5b-47cc-afd5-36a324f26d20 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.691613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af03aa4-ba8c-4679-b5cf-7b64cc8d8b5b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.725367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000bb370-4d5d-459f-9d7c-6a0522c9c30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.726172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb370-4d5d-459f-9d7c-6a0522c9c30b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.726467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb370-4d5d-459f-9d7c-6a0522c9c30b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.726749 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb370-4d5d-459f-9d7c-6a0522c9c30b None admin] PATH_INFO: `/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.735016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:56.737928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:56.742777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bb370-4d5d-459f-9d7c-6a0522c9c30b None admin] RBAC: Authorizing `identity:get_user(user_id=d7bbfccf210d4e55b6247a1a83e1dc0f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:56.744277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000bb370-4d5d-459f-9d7c-6a0522c9c30b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:56.748525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 36/76] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:56.748525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d652812-55ed-4cd7-925f-2d9078d89393 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.748525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d652812-55ed-4cd7-925f-2d9078d89393 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.748525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d652812-55ed-4cd7-925f-2d9078d89393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.763797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5d652812-55ed-4cd7-925f-2d9078d89393 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:56.764993 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5d652812-55ed-4cd7-925f-2d9078d89393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:56.775561 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbcfab-3e5b-47cc-afd5-36a324f26d20 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.810441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691085e1-db8d-41e3-8bf0-89ad692af23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.811351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691085e1-db8d-41e3-8bf0-89ad692af23a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.811644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691085e1-db8d-41e3-8bf0-89ad692af23a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.811921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691085e1-db8d-41e3-8bf0-89ad692af23a None admin] PATH_INFO: `/v3/users/f8e5b4d849064820a77929db188df50b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.813120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691085e1-db8d-41e3-8bf0-89ad692af23a None admin] RBAC: Authorizing `identity:get_user(user_id=f8e5b4d849064820a77929db188df50b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:56.814576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691085e1-db8d-41e3-8bf0-89ad692af23a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:56.816639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 41/77] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/users/f8e5b4d849064820a77929db188df50b => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:56.817404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691085e1-db8d-41e3-8bf0-89ad692af23a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.835394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 37/78] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:26:56.836239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d652812-55ed-4cd7-925f-2d9078d89393 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.916661 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691085e1-db8d-41e3-8bf0-89ad692af23a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.945050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:56.949148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d652812-55ed-4cd7-925f-2d9078d89393 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.956281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51d08c-cb10-4571-a365-740f2ae21e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.956281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51d08c-cb10-4571-a365-740f2ae21e06 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.956281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51d08c-cb10-4571-a365-740f2ae21e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.956281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51d08c-cb10-4571-a365-740f2ae21e06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.962869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51d08c-cb10-4571-a365-740f2ae21e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-bf51d08c-cb10-4571-a365-740f2ae21e06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:26:56.970697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:26:56.972263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 42/79] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:26:56.978005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51d08c-cb10-4571-a365-740f2ae21e06 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.983172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:56.991683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303726ac-2cbb-4dcb-9fc8-e07b99b4dd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.992361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303726ac-2cbb-4dcb-9fc8-e07b99b4dd15 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.992652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303726ac-2cbb-4dcb-9fc8-e07b99b4dd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.992933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303726ac-2cbb-4dcb-9fc8-e07b99b4dd15 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.994500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303726ac-2cbb-4dcb-9fc8-e07b99b4dd15 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:56.994500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303726ac-2cbb-4dcb-9fc8-e07b99b4dd15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:56.995400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303726ac-2cbb-4dcb-9fc8-e07b99b4dd15 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.003421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 38/80] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:57.008747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303726ac-2cbb-4dcb-9fc8-e07b99b4dd15 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.073259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51d08c-cb10-4571-a365-740f2ae21e06 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.105695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303726ac-2cbb-4dcb-9fc8-e07b99b4dd15 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.107367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43446d-14be-45bf-b58e-88d1fe976622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:57.108026 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43446d-14be-45bf-b58e-88d1fe976622 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:57.108318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43446d-14be-45bf-b58e-88d1fe976622 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:57.108611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43446d-14be-45bf-b58e-88d1fe976622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:57.138954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547936b-2303-46ea-9e8f-bdbc77e32739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:57.139591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547936b-2303-46ea-9e8f-bdbc77e32739 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:57.139878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547936b-2303-46ea-9e8f-bdbc77e32739 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:57.140155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547936b-2303-46ea-9e8f-bdbc77e32739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:57.166126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:57.176324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43446d-14be-45bf-b58e-88d1fe976622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:57.177840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43446d-14be-45bf-b58e-88d1fe976622 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.195708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:57.206154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547936b-2303-46ea-9e8f-bdbc77e32739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:57.207663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547936b-2303-46ea-9e8f-bdbc77e32739 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.277986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 43/81] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:57.278759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43446d-14be-45bf-b58e-88d1fe976622 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.306068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 39/82] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:57.307819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547936b-2303-46ea-9e8f-bdbc77e32739 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.370537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:57.380526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43446d-14be-45bf-b58e-88d1fe976622 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.397796 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:57.406771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547936b-2303-46ea-9e8f-bdbc77e32739 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.415601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64850c1e-71e9-4d0f-9cc6-65de05be78b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:57.416401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64850c1e-71e9-4d0f-9cc6-65de05be78b2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:57.416689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64850c1e-71e9-4d0f-9cc6-65de05be78b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:57.417012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64850c1e-71e9-4d0f-9cc6-65de05be78b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:57.418178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64850c1e-71e9-4d0f-9cc6-65de05be78b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:57.419731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64850c1e-71e9-4d0f-9cc6-65de05be78b2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.421366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 44/83] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:26:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:57.422123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64850c1e-71e9-4d0f-9cc6-65de05be78b2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.440845 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69457b-db82-42d8-823b-0cf86a22fc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:57.441522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69457b-db82-42d8-823b-0cf86a22fc6d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:57.441816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69457b-db82-42d8-823b-0cf86a22fc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:57.442100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69457b-db82-42d8-823b-0cf86a22fc6d None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:57.442877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69457b-db82-42d8-823b-0cf86a22fc6d None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:57.443188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69457b-db82-42d8-823b-0cf86a22fc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:57.444567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69457b-db82-42d8-823b-0cf86a22fc6d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.452755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 40/84] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:26:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:57.453609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69457b-db82-42d8-823b-0cf86a22fc6d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.528297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64850c1e-71e9-4d0f-9cc6-65de05be78b2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.551447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69457b-db82-42d8-823b-0cf86a22fc6d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.560881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f88a9-30c2-4d0e-80da-2721da2ada0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:57.561758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f88a9-30c2-4d0e-80da-2721da2ada0f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:57.562048 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f88a9-30c2-4d0e-80da-2721da2ada0f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:57.562337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f88a9-30c2-4d0e-80da-2721da2ada0f None admin] PATH_INFO: `/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:57.563600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f88a9-30c2-4d0e-80da-2721da2ada0f None admin] RBAC: Authorizing `identity:get_user(user_id=d7bbfccf210d4e55b6247a1a83e1dc0f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:57.565646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f88a9-30c2-4d0e-80da-2721da2ada0f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.567320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 45/85] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:26:57 2022] GET /identity/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:57.568085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f88a9-30c2-4d0e-80da-2721da2ada0f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.590444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5651-dd60-4c05-9ac9-f5d0e731b4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:57.591450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5651-dd60-4c05-9ac9-f5d0e731b4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:57.591802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5651-dd60-4c05-9ac9-f5d0e731b4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:57.592091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be5651-dd60-4c05-9ac9-f5d0e731b4a9 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:57.593410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5651-dd60-4c05-9ac9-f5d0e731b4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:57.594865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be5651-dd60-4c05-9ac9-f5d0e731b4a9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.595684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:57.597342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 41/86] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:26:57 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:57.598091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5651-dd60-4c05-9ac9-f5d0e731b4a9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.620954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:57.672567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f88a9-30c2-4d0e-80da-2721da2ada0f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.698041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be5651-dd60-4c05-9ac9-f5d0e731b4a9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.706427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916790d7-eb56-443c-be71-46a24679070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:57.707415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916790d7-eb56-443c-be71-46a24679070a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:57.707712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916790d7-eb56-443c-be71-46a24679070a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:57.707997 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916790d7-eb56-443c-be71-46a24679070a None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:57.709219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916790d7-eb56-443c-be71-46a24679070a None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:57.717384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916790d7-eb56-443c-be71-46a24679070a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.719164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 46/87] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:26:57 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:57.719936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916790d7-eb56-443c-be71-46a24679070a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.734674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0985e-bcb6-4913-b291-5996d8b7faa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:57.735371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0985e-bcb6-4913-b291-5996d8b7faa7 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:57.735660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0985e-bcb6-4913-b291-5996d8b7faa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:57.735941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0985e-bcb6-4913-b291-5996d8b7faa7 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:57.737276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0985e-bcb6-4913-b291-5996d8b7faa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:57.738724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0985e-bcb6-4913-b291-5996d8b7faa7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.814595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:57.821346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916790d7-eb56-443c-be71-46a24679070a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.840202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 42/88] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:26:57 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:57.841034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0985e-bcb6-4913-b291-5996d8b7faa7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.857788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb66be-e510-49b9-868d-4c14d0623612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:57.858683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb66be-e510-49b9-868d-4c14d0623612 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:57.859005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb66be-e510-49b9-868d-4c14d0623612 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:57.859291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb66be-e510-49b9-868d-4c14d0623612 None admin] PATH_INFO: `/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:57.860568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb66be-e510-49b9-868d-4c14d0623612 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bbfccf210d4e55b6247a1a83e1dc0f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:57.862695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb66be-e510-49b9-868d-4c14d0623612 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:57.864472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 47/89] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:26:57 2022] GET /identity/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:57.867967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb66be-e510-49b9-868d-4c14d0623612 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:57.956885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:57.982164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0985e-bcb6-4913-b291-5996d8b7faa7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:57.985472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb66be-e510-49b9-868d-4c14d0623612 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:58.022646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caedcb-0dff-4fcb-8398-ae528d415f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:58.023697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caedcb-0dff-4fcb-8398-ae528d415f59 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:58.023697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caedcb-0dff-4fcb-8398-ae528d415f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:58.023878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8caedcb-0dff-4fcb-8398-ae528d415f59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:58.030049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083490e-553f-460c-b01c-f77c725052c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:58.030749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083490e-553f-460c-b01c-f77c725052c3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:58.031084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083490e-553f-460c-b01c-f77c725052c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:58.031370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083490e-553f-460c-b01c-f77c725052c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:58.032739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083490e-553f-460c-b01c-f77c725052c3 None admin] RBAC: Adding query filter params (role.id=67691f718ae34424ae84912841aee8df, scope.project.id=8867c613b3214d72b178a25b63c2e0af, user.id=d7bbfccf210d4e55b6247a1a83e1dc0f) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:58.032739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083490e-553f-460c-b01c-f77c725052c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:58.034996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083490e-553f-460c-b01c-f77c725052c3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:58.041657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 48/90] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:26:57 2022] GET /identity/v3/role_assignments?user.id=d7bbfccf210d4e55b6247a1a83e1dc0f&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=67691f718ae34424ae84912841aee8df => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:58.042528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083490e-553f-460c-b01c-f77c725052c3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:58.076579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:58.119970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8caedcb-0dff-4fcb-8398-ae528d415f59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:58.121496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8caedcb-0dff-4fcb-8398-ae528d415f59 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:58.182544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083490e-553f-460c-b01c-f77c725052c3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:58.225935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:58.226815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd97e6-8499-4670-bafe-3f223e06cb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:58.227535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd97e6-8499-4670-bafe-3f223e06cb59 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:58.227872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd97e6-8499-4670-bafe-3f223e06cb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:58.228161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd97e6-8499-4670-bafe-3f223e06cb59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:58.229029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd97e6-8499-4670-bafe-3f223e06cb59 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=8867c613b3214d72b178a25b63c2e0af, user.id=f8e5b4d849064820a77929db188df50b) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:58.229350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd97e6-8499-4670-bafe-3f223e06cb59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:58.230877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd97e6-8499-4670-bafe-3f223e06cb59 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:58.239516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 49/91] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:26:58 2022] GET /identity/v3/role_assignments?user.id=f8e5b4d849064820a77929db188df50b&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=9312183c32b04118985c8316f33f3830 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:58.240454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd97e6-8499-4670-bafe-3f223e06cb59 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:58.262578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 43/92] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:58.270878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caedcb-0dff-4fcb-8398-ae528d415f59 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:58.412662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:58.424606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd97e6-8499-4670-bafe-3f223e06cb59 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:58.437034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8caedcb-0dff-4fcb-8398-ae528d415f59 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:58.488167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607522b-1ee4-4a77-9418-5de2ebf696b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:58.489055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607522b-1ee4-4a77-9418-5de2ebf696b0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:58.489343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607522b-1ee4-4a77-9418-5de2ebf696b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:58.489621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607522b-1ee4-4a77-9418-5de2ebf696b0 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:58.491574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607522b-1ee4-4a77-9418-5de2ebf696b0 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:58.493056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607522b-1ee4-4a77-9418-5de2ebf696b0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:58.494989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 44/93] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:26:58 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:58.502836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607522b-1ee4-4a77-9418-5de2ebf696b0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:58.506958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585285d-a139-498d-87f6-54fb3c0c6117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:58.507673 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585285d-a139-498d-87f6-54fb3c0c6117 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:58.507967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585285d-a139-498d-87f6-54fb3c0c6117 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:58.508248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585285d-a139-498d-87f6-54fb3c0c6117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:58.575484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:58.684976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607522b-1ee4-4a77-9418-5de2ebf696b0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:58.704308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585285d-a139-498d-87f6-54fb3c0c6117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:58.706345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585285d-a139-498d-87f6-54fb3c0c6117 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:58.756377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39276934-e2eb-42b5-819d-74a189272d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:58.757045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39276934-e2eb-42b5-819d-74a189272d5e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:58.757334 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39276934-e2eb-42b5-819d-74a189272d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:58.757614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39276934-e2eb-42b5-819d-74a189272d5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:58.758456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39276934-e2eb-42b5-819d-74a189272d5e None admin] RBAC: Adding query filter params (role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=8867c613b3214d72b178a25b63c2e0af, user.id=d7bbfccf210d4e55b6247a1a83e1dc0f) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:58.758772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39276934-e2eb-42b5-819d-74a189272d5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:58.760257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39276934-e2eb-42b5-819d-74a189272d5e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:58.773981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 45/94] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:26:58 2022] GET /identity/v3/role_assignments?user.id=d7bbfccf210d4e55b6247a1a83e1dc0f&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:58.877078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 50/95] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:26:58.877687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:58.883142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39276934-e2eb-42b5-819d-74a189272d5e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:58.998321 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39276934-e2eb-42b5-819d-74a189272d5e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:59.010454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:59.037047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af92326-03fc-4bd7-b92b-c8d87f50325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:59.037937 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af92326-03fc-4bd7-b92b-c8d87f50325e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:59.038225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af92326-03fc-4bd7-b92b-c8d87f50325e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:59.038506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af92326-03fc-4bd7-b92b-c8d87f50325e None admin] PATH_INFO: `/v3/projects/be7cdcc8bb6b4cc58739c4d277c2cbf7` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:59.039769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af92326-03fc-4bd7-b92b-c8d87f50325e None admin] RBAC: Authorizing `identity:get_project(project_id=be7cdcc8bb6b4cc58739c4d277c2cbf7)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:59.041224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af92326-03fc-4bd7-b92b-c8d87f50325e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:59.043279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 46/96] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:26:58 2022] GET /identity/v3/projects/be7cdcc8bb6b4cc58739c4d277c2cbf7 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:59.049154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585285d-a139-498d-87f6-54fb3c0c6117 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:59.209459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585285d-a139-498d-87f6-54fb3c0c6117 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:59.257848 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685dc6d-75eb-4d81-816e-77843ba35da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:59.258831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685dc6d-75eb-4d81-816e-77843ba35da5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:59.259334 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685dc6d-75eb-4d81-816e-77843ba35da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:59.259784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685dc6d-75eb-4d81-816e-77843ba35da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:59.260820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685dc6d-75eb-4d81-816e-77843ba35da5 None admin] RBAC: Adding query filter params (role.id=67691f718ae34424ae84912841aee8df, scope.project.id=be7cdcc8bb6b4cc58739c4d277c2cbf7, user.id=d7bbfccf210d4e55b6247a1a83e1dc0f) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:59.261322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685dc6d-75eb-4d81-816e-77843ba35da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:59.262992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685dc6d-75eb-4d81-816e-77843ba35da5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:59.275239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 51/97] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:26:59 2022] GET /identity/v3/role_assignments?user.id=d7bbfccf210d4e55b6247a1a83e1dc0f&scope.project.id=be7cdcc8bb6b4cc58739c4d277c2cbf7&role.id=67691f718ae34424ae84912841aee8df => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:01.057368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335f911-4bf1-4e1b-b8ec-b6b7f339904f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.057879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335f911-4bf1-4e1b-b8ec-b6b7f339904f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.058144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335f911-4bf1-4e1b-b8ec-b6b7f339904f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.059784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 47/98] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:01.065833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7ef49-1f8b-4156-80f0-9f7d14059b05 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.066767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7ef49-1f8b-4156-80f0-9f7d14059b05 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.067278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7ef49-1f8b-4156-80f0-9f7d14059b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.091522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ffd7ef49-1f8b-4156-80f0-9f7d14059b05 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:01.093051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ffd7ef49-1f8b-4156-80f0-9f7d14059b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:01.100599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c525840-1f91-41cb-a643-24c695052b49 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.101178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c525840-1f91-41cb-a643-24c695052b49 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.101652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c525840-1f91-41cb-a643-24c695052b49 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.103272 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 48/99] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:01.113530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214bce9-b269-404f-bc51-8fcc00275c25 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.114132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214bce9-b269-404f-bc51-8fcc00275c25 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.114623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214bce9-b269-404f-bc51-8fcc00275c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.139467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f214bce9-b269-404f-bc51-8fcc00275c25 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:01.141282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f214bce9-b269-404f-bc51-8fcc00275c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:01.196638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:01.224814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 52/100] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:01.226434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb8f33-ac82-49f0-bdea-76bf5981227d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.226974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb8f33-ac82-49f0-bdea-76bf5981227d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.227448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb8f33-ac82-49f0-bdea-76bf5981227d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.228989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 53/101] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:01.230917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa892-bd2e-4ae8-aeeb-ea5661d4ebfa None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.231421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa892-bd2e-4ae8-aeeb-ea5661d4ebfa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.232270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aa892-bd2e-4ae8-aeeb-ea5661d4ebfa None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.234149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 54/102] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:01.235697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56ee0a-11ee-4310-948c-65e423ea9e0b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.236178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56ee0a-11ee-4310-948c-65e423ea9e0b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.237264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56ee0a-11ee-4310-948c-65e423ea9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.241775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 49/103] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:01.243257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7fdd0-003f-4220-9245-046feff182c3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.243550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7fdd0-003f-4220-9245-046feff182c3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.243834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7fdd0-003f-4220-9245-046feff182c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.256471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5c56ee0a-11ee-4310-948c-65e423ea9e0b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:01.257986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5c56ee0a-11ee-4310-948c-65e423ea9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:01.272162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-71d7fdd0-003f-4220-9245-046feff182c3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:01.273383 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-71d7fdd0-003f-4220-9245-046feff182c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:01.345686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 55/104] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:01.347688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 50/105] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:01.348421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56ee0a-11ee-4310-948c-65e423ea9e0b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:01.348606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7fdd0-003f-4220-9245-046feff182c3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:01.383788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:01.452043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7fdd0-003f-4220-9245-046feff182c3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:01.468449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56ee0a-11ee-4310-948c-65e423ea9e0b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:01.484911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:01.488857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc788663-3967-4766-95bf-73ebff8f0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:01.489589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc788663-3967-4766-95bf-73ebff8f0d8f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.489886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc788663-3967-4766-95bf-73ebff8f0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.490171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc788663-3967-4766-95bf-73ebff8f0d8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.491409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc788663-3967-4766-95bf-73ebff8f0d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:01.492870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc788663-3967-4766-95bf-73ebff8f0d8f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:01.494501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 51/106] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:01.495384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc788663-3967-4766-95bf-73ebff8f0d8f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:01.508900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f46948-8809-4851-8d38-074241e389a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:01.510014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f46948-8809-4851-8d38-074241e389a0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.510492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f46948-8809-4851-8d38-074241e389a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.511086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f46948-8809-4851-8d38-074241e389a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.522190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f46948-8809-4851-8d38-074241e389a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-57f46948-8809-4851-8d38-074241e389a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:01.530862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:01.531688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:01.532428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:01.535320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 56/107] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:01.536327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f46948-8809-4851-8d38-074241e389a0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:01.621735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc788663-3967-4766-95bf-73ebff8f0d8f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:01.624165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:01.660014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f46948-8809-4851-8d38-074241e389a0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:01.665211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a89d23-bcf4-4c0b-8955-d5a8a5745fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:01.666250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a89d23-bcf4-4c0b-8955-d5a8a5745fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.666730 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a89d23-bcf4-4c0b-8955-d5a8a5745fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.667235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a89d23-bcf4-4c0b-8955-d5a8a5745fb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.679314 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a89d23-bcf4-4c0b-8955-d5a8a5745fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-b7a89d23-bcf4-4c0b-8955-d5a8a5745fb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:01.687447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:01.688268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:01.689012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:01.691441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 52/108] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:01.692423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a89d23-bcf4-4c0b-8955-d5a8a5745fb6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:01.700993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffffca8-8ba0-4e3d-969a-87c2e89868ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:01.702368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffffca8-8ba0-4e3d-969a-87c2e89868ba None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.702957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffffca8-8ba0-4e3d-969a-87c2e89868ba None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.703897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffffca8-8ba0-4e3d-969a-87c2e89868ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.723071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffffca8-8ba0-4e3d-969a-87c2e89868ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-bffffca8-8ba0-4e3d-969a-87c2e89868ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:01.735032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:01.735871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:01.736715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 57/109] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:01.737689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffffca8-8ba0-4e3d-969a-87c2e89868ba None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:01.815966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:01.873425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a89d23-bcf4-4c0b-8955-d5a8a5745fb6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:01.892724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffffca8-8ba0-4e3d-969a-87c2e89868ba None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:01.918835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaee21-c6d6-482b-9ea0-fa07c3dcf989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:01.919832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaee21-c6d6-482b-9ea0-fa07c3dcf989 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.920354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaee21-c6d6-482b-9ea0-fa07c3dcf989 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.920739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffaee21-c6d6-482b-9ea0-fa07c3dcf989 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.921819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaee21-c6d6-482b-9ea0-fa07c3dcf989 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:01.924119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffaee21-c6d6-482b-9ea0-fa07c3dcf989 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:01.934400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e74ff-54d2-4fdf-962e-d70d9b8f290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:01.935470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e74ff-54d2-4fdf-962e-d70d9b8f290a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:01.935923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e74ff-54d2-4fdf-962e-d70d9b8f290a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:01.936355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4e74ff-54d2-4fdf-962e-d70d9b8f290a None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:01.937359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e74ff-54d2-4fdf-962e-d70d9b8f290a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:01.937815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e74ff-54d2-4fdf-962e-d70d9b8f290a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:01.939400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4e74ff-54d2-4fdf-962e-d70d9b8f290a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:01.948929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 58/110] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:01.950084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e74ff-54d2-4fdf-962e-d70d9b8f290a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.053853 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 53/111] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:27:01 2022] POST /identity/v3/projects => generated 302 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:02.055067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaee21-c6d6-482b-9ea0-fa07c3dcf989 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.066693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:02.076584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4e74ff-54d2-4fdf-962e-d70d9b8f290a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.077523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:02.125414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b5101-717a-45fa-b52c-69a6a9eb5c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.126448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b5101-717a-45fa-b52c-69a6a9eb5c14 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.127002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b5101-717a-45fa-b52c-69a6a9eb5c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.128177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b5101-717a-45fa-b52c-69a6a9eb5c14 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.129754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b5101-717a-45fa-b52c-69a6a9eb5c14 None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:02.130278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b5101-717a-45fa-b52c-69a6a9eb5c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:02.131950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b5101-717a-45fa-b52c-69a6a9eb5c14 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:02.141881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 59/112] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:02.144418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b5101-717a-45fa-b52c-69a6a9eb5c14 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.184689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffaee21-c6d6-482b-9ea0-fa07c3dcf989 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.230071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8806f4-9927-4c19-b99e-011e2506113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.230751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8806f4-9927-4c19-b99e-011e2506113d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.231064 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8806f4-9927-4c19-b99e-011e2506113d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.231345 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8806f4-9927-4c19-b99e-011e2506113d None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.232363 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8806f4-9927-4c19-b99e-011e2506113d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:02.232668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8806f4-9927-4c19-b99e-011e2506113d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:02.234084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8806f4-9927-4c19-b99e-011e2506113d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:02.244027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 54/113] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:02.245336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077c94-beb0-41ad-ae76-642c3e74f299 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.245631 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077c94-beb0-41ad-ae76-642c3e74f299 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.245916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077c94-beb0-41ad-ae76-642c3e74f299 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.247184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 55/114] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:02.247878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077c94-beb0-41ad-ae76-642c3e74f299 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.274179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b5101-717a-45fa-b52c-69a6a9eb5c14 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.312319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1be4eb-c724-4b5d-99c3-244c0f835202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.313208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be4eb-c724-4b5d-99c3-244c0f835202 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.313502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be4eb-c724-4b5d-99c3-244c0f835202 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.313790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be4eb-c724-4b5d-99c3-244c0f835202 None admin] PATH_INFO: `/v3/users/03e5fefe8f3a4d94b7ee4b4f7c5d1df8` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.328463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1be4eb-c724-4b5d-99c3-244c0f835202 None admin] RBAC: Authorizing `identity:get_user(user_id=03e5fefe8f3a4d94b7ee4b4f7c5d1df8)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:02.329943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1be4eb-c724-4b5d-99c3-244c0f835202 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:02.332401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 60/115] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/users/03e5fefe8f3a4d94b7ee4b4f7c5d1df8 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:02.333457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1fd7f-cc23-4701-be52-a94b8e3e4b25 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.333750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1fd7f-cc23-4701-be52-a94b8e3e4b25 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.334032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1fd7f-cc23-4701-be52-a94b8e3e4b25 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.335431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 61/116] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:02.335999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1fd7f-cc23-4701-be52-a94b8e3e4b25 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.350586 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:02.355068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:02.373747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077c94-beb0-41ad-ae76-642c3e74f299 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.411319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd993347-cda5-46a6-8359-24495a7e3aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.412556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993347-cda5-46a6-8359-24495a7e3aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.412856 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993347-cda5-46a6-8359-24495a7e3aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.413186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993347-cda5-46a6-8359-24495a7e3aa5 None admin] PATH_INFO: `/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.414473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd993347-cda5-46a6-8359-24495a7e3aa5 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bbfccf210d4e55b6247a1a83e1dc0f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:02.415937 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd993347-cda5-46a6-8359-24495a7e3aa5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:02.417606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 56/117] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:02.418873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921134d-2db0-4a59-86e6-31394158f229 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.419168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921134d-2db0-4a59-86e6-31394158f229 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.419455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921134d-2db0-4a59-86e6-31394158f229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.437823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7921134d-2db0-4a59-86e6-31394158f229 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:02.439072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7921134d-2db0-4a59-86e6-31394158f229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:02.450546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1fd7f-cc23-4701-be52-a94b8e3e4b25 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.488872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81f3e6-0808-4bf2-a73a-0b0142d5e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.489752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f3e6-0808-4bf2-a73a-0b0142d5e767 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.490037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f3e6-0808-4bf2-a73a-0b0142d5e767 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.490311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81f3e6-0808-4bf2-a73a-0b0142d5e767 None admin] PATH_INFO: `/v3/users/f8e5b4d849064820a77929db188df50b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.491516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81f3e6-0808-4bf2-a73a-0b0142d5e767 None admin] RBAC: Authorizing `identity:get_user(user_id=f8e5b4d849064820a77929db188df50b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:02.492962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a81f3e6-0808-4bf2-a73a-0b0142d5e767 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:02.494742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 62/118] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/users/f8e5b4d849064820a77929db188df50b => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:02.495361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81f3e6-0808-4bf2-a73a-0b0142d5e767 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.511613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 57/119] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:02.512761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dfbcb-187f-45e2-bb01-e3c43aa1eb29 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.513058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dfbcb-187f-45e2-bb01-e3c43aa1eb29 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.513338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76dfbcb-187f-45e2-bb01-e3c43aa1eb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.530103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d76dfbcb-187f-45e2-bb01-e3c43aa1eb29 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:02.531308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d76dfbcb-187f-45e2-bb01-e3c43aa1eb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:02.600948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:02.622887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 58/120] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:02.622887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dfbcb-187f-45e2-bb01-e3c43aa1eb29 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.623131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a81f3e6-0808-4bf2-a73a-0b0142d5e767 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.631685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:02.654640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df8656-57f6-4235-8fb5-de5d33c9968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.655353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df8656-57f6-4235-8fb5-de5d33c9968b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.655665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df8656-57f6-4235-8fb5-de5d33c9968b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.655932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df8656-57f6-4235-8fb5-de5d33c9968b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.728987 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df8656-57f6-4235-8fb5-de5d33c9968b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:02.730426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df8656-57f6-4235-8fb5-de5d33c9968b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:02.734628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76dfbcb-187f-45e2-bb01-e3c43aa1eb29 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.773789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866765e-f0f2-4ce6-ad56-c33c2f343368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.775172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866765e-f0f2-4ce6-ad56-c33c2f343368 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.775474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866765e-f0f2-4ce6-ad56-c33c2f343368 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.775761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866765e-f0f2-4ce6-ad56-c33c2f343368 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.777694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866765e-f0f2-4ce6-ad56-c33c2f343368 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:02.779628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866765e-f0f2-4ce6-ad56-c33c2f343368 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:02.781840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 59/121] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:02.782798 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866765e-f0f2-4ce6-ad56-c33c2f343368 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.825532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:02.844952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 63/122] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:02.846417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df8656-57f6-4235-8fb5-de5d33c9968b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.864397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:02.890745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866765e-f0f2-4ce6-ad56-c33c2f343368 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.928238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5171e-b01d-4755-a164-701c788b834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.929110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5171e-b01d-4755-a164-701c788b834a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.929688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5171e-b01d-4755-a164-701c788b834a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.929984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5171e-b01d-4755-a164-701c788b834a None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.931198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5171e-b01d-4755-a164-701c788b834a None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:02.932645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5171e-b01d-4755-a164-701c788b834a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:02.934345 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 60/123] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:02.935151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5171e-b01d-4755-a164-701c788b834a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.959543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df8656-57f6-4235-8fb5-de5d33c9968b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.995882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a852c7a-588f-4cd5-b6c7-8a754e806d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.996615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a852c7a-588f-4cd5-b6c7-8a754e806d0e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.996905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a852c7a-588f-4cd5-b6c7-8a754e806d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.997186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a852c7a-588f-4cd5-b6c7-8a754e806d0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.008440 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a852c7a-588f-4cd5-b6c7-8a754e806d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3a852c7a-588f-4cd5-b6c7-8a754e806d0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:03.016336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:03.017177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:03.018677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 64/124] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:03.019988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a852c7a-588f-4cd5-b6c7-8a754e806d0e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.047286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5171e-b01d-4755-a164-701c788b834a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:03.065265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:03.084837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c42101-861f-430e-8d6b-0287c27bc36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:03.085664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c42101-861f-430e-8d6b-0287c27bc36a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:03.085957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c42101-861f-430e-8d6b-0287c27bc36a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:03.086252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c42101-861f-430e-8d6b-0287c27bc36a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.097037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c42101-861f-430e-8d6b-0287c27bc36a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-52c42101-861f-430e-8d6b-0287c27bc36a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:03.105382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:03.106325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 61/125] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:03.107714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c42101-861f-430e-8d6b-0287c27bc36a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.110649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:03.131235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a852c7a-588f-4cd5-b6c7-8a754e806d0e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:03.169812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeb9fb-07c3-4b9c-9b89-5032080f5c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:03.170741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeb9fb-07c3-4b9c-9b89-5032080f5c2d None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:03.171061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeb9fb-07c3-4b9c-9b89-5032080f5c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:03.171370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deeb9fb-07c3-4b9c-9b89-5032080f5c2d None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af/users/d7bbfccf210d4e55b6247a1a83e1dc0f/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.173375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deeb9fb-07c3-4b9c-9b89-5032080f5c2d None admin] RBAC: Authorizing `identity:create_grant(project_id=8867c613b3214d72b178a25b63c2e0af, user_id=d7bbfccf210d4e55b6247a1a83e1dc0f, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:03.175399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deeb9fb-07c3-4b9c-9b89-5032080f5c2d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:03.213097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c42101-861f-430e-8d6b-0287c27bc36a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:03.242682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 65/126] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:27:03 2022] PUT /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af/users/d7bbfccf210d4e55b6247a1a83e1dc0f/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:03.253525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317487-65c4-4826-b43a-137a5f951f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:03.253525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317487-65c4-4826-b43a-137a5f951f73 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:03.253525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317487-65c4-4826-b43a-137a5f951f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:03.253525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317487-65c4-4826-b43a-137a5f951f73 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.254016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeb9fb-07c3-4b9c-9b89-5032080f5c2d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.254110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5317487-65c4-4826-b43a-137a5f951f73 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:03.254365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5317487-65c4-4826-b43a-137a5f951f73 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:03.256163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 62/127] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:03 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:03.257070 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317487-65c4-4826-b43a-137a5f951f73 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.353938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:03.401386 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317487-65c4-4826-b43a-137a5f951f73 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:03.423016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deeb9fb-07c3-4b9c-9b89-5032080f5c2d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:03.434100 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:03.449362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a863d6-3ec0-453f-b153-c4bafc427c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:03.450126 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a863d6-3ec0-453f-b153-c4bafc427c93 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:03.450486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a863d6-3ec0-453f-b153-c4bafc427c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:03.451166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a863d6-3ec0-453f-b153-c4bafc427c93 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.452302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a863d6-3ec0-453f-b153-c4bafc427c93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:03.452302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a863d6-3ec0-453f-b153-c4bafc427c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:03.453499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a863d6-3ec0-453f-b153-c4bafc427c93 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:03.462217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 63/128] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:03.465392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a863d6-3ec0-453f-b153-c4bafc427c93 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.470045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebc0f8-e44c-4f0f-b296-2a7071212b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:03.472324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebc0f8-e44c-4f0f-b296-2a7071212b0a None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:03.472648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebc0f8-e44c-4f0f-b296-2a7071212b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:03.472979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebc0f8-e44c-4f0f-b296-2a7071212b0a None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af/users/f8e5b4d849064820a77929db188df50b/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.475083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebc0f8-e44c-4f0f-b296-2a7071212b0a None admin] RBAC: Authorizing `identity:create_grant(project_id=8867c613b3214d72b178a25b63c2e0af, user_id=f8e5b4d849064820a77929db188df50b, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:03.476620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebc0f8-e44c-4f0f-b296-2a7071212b0a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:03.571794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 66/129] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:27:03 2022] PUT /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af/users/f8e5b4d849064820a77929db188df50b/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:03.572881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebc0f8-e44c-4f0f-b296-2a7071212b0a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.577214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a863d6-3ec0-453f-b153-c4bafc427c93 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:03.614732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:03.620935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875b3c9-b349-4628-a23f-b0ce1dc57be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:03.621925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875b3c9-b349-4628-a23f-b0ce1dc57be5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:03.622389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875b3c9-b349-4628-a23f-b0ce1dc57be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:03.622914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875b3c9-b349-4628-a23f-b0ce1dc57be5 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.623932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875b3c9-b349-4628-a23f-b0ce1dc57be5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:03.624458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875b3c9-b349-4628-a23f-b0ce1dc57be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:03.626120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875b3c9-b349-4628-a23f-b0ce1dc57be5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:03.637667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 64/130] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:03.638953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875b3c9-b349-4628-a23f-b0ce1dc57be5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.689545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebc0f8-e44c-4f0f-b296-2a7071212b0a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:03.728123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dede4a-b627-4d82-a735-fa68a33e4604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:03.728852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dede4a-b627-4d82-a735-fa68a33e4604 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:03.729211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dede4a-b627-4d82-a735-fa68a33e4604 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:03.729606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dede4a-b627-4d82-a735-fa68a33e4604 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.730551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dede4a-b627-4d82-a735-fa68a33e4604 None admin] RBAC: Adding query filter params (role.id=b6f66ee2ec664d738bf2a67e41decbc4, scope.project.id=8867c613b3214d72b178a25b63c2e0af, user.id=03e5fefe8f3a4d94b7ee4b4f7c5d1df8) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:03.731121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dede4a-b627-4d82-a735-fa68a33e4604 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:03.732992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dede4a-b627-4d82-a735-fa68a33e4604 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:03.740541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 67/131] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:03 2022] GET /identity/v3/role_assignments?user.id=03e5fefe8f3a4d94b7ee4b4f7c5d1df8&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=b6f66ee2ec664d738bf2a67e41decbc4 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:03.741650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dede4a-b627-4d82-a735-fa68a33e4604 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.761410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875b3c9-b349-4628-a23f-b0ce1dc57be5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:03.778982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:03.812820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094946a-c468-42c2-84d7-35570ebfc387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:03.814063 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094946a-c468-42c2-84d7-35570ebfc387 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:03.815634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094946a-c468-42c2-84d7-35570ebfc387 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:03.816157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094946a-c468-42c2-84d7-35570ebfc387 None admin] PATH_INFO: `/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.817651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094946a-c468-42c2-84d7-35570ebfc387 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bbfccf210d4e55b6247a1a83e1dc0f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:03.819346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094946a-c468-42c2-84d7-35570ebfc387 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:03.821558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 65/132] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:03 2022] GET /identity/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:03.827332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094946a-c468-42c2-84d7-35570ebfc387 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.871084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dede4a-b627-4d82-a735-fa68a33e4604 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:03.907439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:03.917639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0c24d-e6c7-4469-8beb-ec47d8a06a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:03.919600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0c24d-e6c7-4469-8beb-ec47d8a06a63 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:03.919969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0c24d-e6c7-4469-8beb-ec47d8a06a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:03.920325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0c24d-e6c7-4469-8beb-ec47d8a06a63 None admin] PATH_INFO: `/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:03.921692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0c24d-e6c7-4469-8beb-ec47d8a06a63 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bbfccf210d4e55b6247a1a83e1dc0f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:03.923272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0c24d-e6c7-4469-8beb-ec47d8a06a63 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:03.926347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 68/133] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:03 2022] GET /identity/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:03.933008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0c24d-e6c7-4469-8beb-ec47d8a06a63 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:03.955625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094946a-c468-42c2-84d7-35570ebfc387 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:04.039375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b96d2-b4fc-456e-bc71-6f3c676e749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:04.040493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b96d2-b4fc-456e-bc71-6f3c676e749d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:04.040950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b96d2-b4fc-456e-bc71-6f3c676e749d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:04.041371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b96d2-b4fc-456e-bc71-6f3c676e749d None admin] PATH_INFO: `/v3/projects/be7cdcc8bb6b4cc58739c4d277c2cbf7` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:04.044727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b96d2-b4fc-456e-bc71-6f3c676e749d None admin] RBAC: Authorizing `identity:get_project(project_id=be7cdcc8bb6b4cc58739c4d277c2cbf7)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:04.046424 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b96d2-b4fc-456e-bc71-6f3c676e749d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:04.048640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 66/134] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:03 2022] GET /identity/v3/projects/be7cdcc8bb6b4cc58739c4d277c2cbf7 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:04.054411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b96d2-b4fc-456e-bc71-6f3c676e749d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:04.083887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:04.091472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0c24d-e6c7-4469-8beb-ec47d8a06a63 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:04.149102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f345-31b2-4e97-a14b-e4ac4a350cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:04.149979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f345-31b2-4e97-a14b-e4ac4a350cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:04.150266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f345-31b2-4e97-a14b-e4ac4a350cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:04.150543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f345-31b2-4e97-a14b-e4ac4a350cd0 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:04.152567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1f345-31b2-4e97-a14b-e4ac4a350cd0 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:04.155089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1f345-31b2-4e97-a14b-e4ac4a350cd0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:04.160098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 69/135] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:03 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:04.163694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f345-31b2-4e97-a14b-e4ac4a350cd0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:04.263185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b96d2-b4fc-456e-bc71-6f3c676e749d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:04.317414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:04.335743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6e61-f6e3-42e8-a93d-144ff4df8b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:04.335743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6e61-f6e3-42e8-a93d-144ff4df8b1e None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:04.335989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6e61-f6e3-42e8-a93d-144ff4df8b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:04.336148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6e61-f6e3-42e8-a93d-144ff4df8b1e None admin] PATH_INFO: `/v3/projects/be7cdcc8bb6b4cc58739c4d277c2cbf7/users/d7bbfccf210d4e55b6247a1a83e1dc0f/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:04.338638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6e61-f6e3-42e8-a93d-144ff4df8b1e None admin] RBAC: Authorizing `identity:create_grant(project_id=be7cdcc8bb6b4cc58739c4d277c2cbf7, user_id=d7bbfccf210d4e55b6247a1a83e1dc0f, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:04.340131 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6e61-f6e3-42e8-a93d-144ff4df8b1e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:04.372971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f345-31b2-4e97-a14b-e4ac4a350cd0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:04.429722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 67/136] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:27:04 2022] PUT /identity/v3/projects/be7cdcc8bb6b4cc58739c4d277c2cbf7/users/d7bbfccf210d4e55b6247a1a83e1dc0f/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:04.435844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c797fb-adfc-4d31-a95c-089b3547fd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:04.436798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c797fb-adfc-4d31-a95c-089b3547fd8b None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:04.437086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c797fb-adfc-4d31-a95c-089b3547fd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:04.437367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c797fb-adfc-4d31-a95c-089b3547fd8b None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af/users/d7bbfccf210d4e55b6247a1a83e1dc0f/roles/3aed2722fbf34ba2bb24b1cb29d49004` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:04.445223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c797fb-adfc-4d31-a95c-089b3547fd8b None admin] RBAC: Authorizing `identity:create_grant(project_id=8867c613b3214d72b178a25b63c2e0af, user_id=d7bbfccf210d4e55b6247a1a83e1dc0f, role_id=3aed2722fbf34ba2bb24b1cb29d49004)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:04.446732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c797fb-adfc-4d31-a95c-089b3547fd8b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:04.475283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae529b3-7428-4700-b13a-1c906ed6147b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:04.475743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae529b3-7428-4700-b13a-1c906ed6147b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:04.476109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae529b3-7428-4700-b13a-1c906ed6147b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:04.477596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 68/137] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:04.483834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d7af-c43d-437e-9be8-dada89f2a056 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:04.484128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d7af-c43d-437e-9be8-dada89f2a056 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:04.484412 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3d7af-c43d-437e-9be8-dada89f2a056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:04.517276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-eee3d7af-c43d-437e-9be8-dada89f2a056 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:04.518716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eee3d7af-c43d-437e-9be8-dada89f2a056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:04.558011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 70/138] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:27:04 2022] PUT /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af/users/d7bbfccf210d4e55b6247a1a83e1dc0f/roles/3aed2722fbf34ba2bb24b1cb29d49004 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:04.641459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 69/139] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:04.692993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c797fb-adfc-4d31-a95c-089b3547fd8b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:04.724378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:04.820981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c797fb-adfc-4d31-a95c-089b3547fd8b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:04.864608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8395cca-1afa-47c2-949d-f03c1ea12072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:04.865338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8395cca-1afa-47c2-949d-f03c1ea12072 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:04.865623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8395cca-1afa-47c2-949d-f03c1ea12072 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:04.865899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8395cca-1afa-47c2-949d-f03c1ea12072 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:04.867164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8395cca-1afa-47c2-949d-f03c1ea12072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:04.868625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8395cca-1afa-47c2-949d-f03c1ea12072 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:04.870430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 71/140] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:04.875982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d7af-c43d-437e-9be8-dada89f2a056 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:05.029224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3d7af-c43d-437e-9be8-dada89f2a056 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:05.061849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:05.081420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136ac95-d724-4d39-b366-b46d1de8d7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:05.082054 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ac95-d724-4d39-b366-b46d1de8d7a4 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:05.082284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ac95-d724-4d39-b366-b46d1de8d7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:05.082523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136ac95-d724-4d39-b366-b46d1de8d7a4 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:05.083284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136ac95-d724-4d39-b366-b46d1de8d7a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:05.084783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136ac95-d724-4d39-b366-b46d1de8d7a4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:05.186192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 70/141] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:04 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:06.316102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13397ba-b8f5-47c0-8eab-f2984fc4ec4f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:06.316634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13397ba-b8f5-47c0-8eab-f2984fc4ec4f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:06.316709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13397ba-b8f5-47c0-8eab-f2984fc4ec4f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:06.318311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 72/142] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:06.324646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfdb23-5480-46fe-bc07-2c2fb3f1bb74 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:06.325078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfdb23-5480-46fe-bc07-2c2fb3f1bb74 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:06.325249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfdb23-5480-46fe-bc07-2c2fb3f1bb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:06.347923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d9dfdb23-5480-46fe-bc07-2c2fb3f1bb74 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:06.349458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d9dfdb23-5480-46fe-bc07-2c2fb3f1bb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:06.430820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:06.473849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13397ba-b8f5-47c0-8eab-f2984fc4ec4f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:06.497275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60770dba-365e-4ff4-9a7a-2cb4be003bd9 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:06.498012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60770dba-365e-4ff4-9a7a-2cb4be003bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:06.498497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60770dba-365e-4ff4-9a7a-2cb4be003bd9 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:06.500183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 72/144] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:06.508093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac39c3-3d1a-46ef-a6c7-5dcdddc56951 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:06.508689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac39c3-3d1a-46ef-a6c7-5dcdddc56951 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:06.509312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac39c3-3d1a-46ef-a6c7-5dcdddc56951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:06.544122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ffac39c3-3d1a-46ef-a6c7-5dcdddc56951 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:06.545692 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ffac39c3-3d1a-46ef-a6c7-5dcdddc56951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:06.619580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:06.639560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13397ba-b8f5-47c0-8eab-f2984fc4ec4f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:06.695262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82059e-7841-43f5-8c7f-cc43beb537e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:06.696080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82059e-7841-43f5-8c7f-cc43beb537e3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:06.696361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82059e-7841-43f5-8c7f-cc43beb537e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:06.696634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82059e-7841-43f5-8c7f-cc43beb537e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:06.716252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82059e-7841-43f5-8c7f-cc43beb537e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-fc82059e-7841-43f5-8c7f-cc43beb537e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:06.725767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:06.726695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:06.727468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:06.728039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 73/145] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:06.728121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 73/146] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:06.730054 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e0ca6-2a24-45a9-b765-c780d5c0ceb1 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:06.730348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e0ca6-2a24-45a9-b765-c780d5c0ceb1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:06.730629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e0ca6-2a24-45a9-b765-c780d5c0ceb1 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:06.732248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 74/147] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:06.733146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82059e-7841-43f5-8c7f-cc43beb537e3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:06.739510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b43aa-4ee4-4785-b753-871bd0cefbff None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:06.740073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b43aa-4ee4-4785-b753-871bd0cefbff None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:06.740605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b43aa-4ee4-4785-b753-871bd0cefbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:06.759348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3d2b43aa-4ee4-4785-b753-871bd0cefbff None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:06.760909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3d2b43aa-4ee4-4785-b753-871bd0cefbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:06.806507 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:06.883710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 75/148] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:06.885044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b43aa-4ee4-4785-b753-871bd0cefbff None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:06.930181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82059e-7841-43f5-8c7f-cc43beb537e3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:06.994802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd838d-d116-4ada-8889-68dd80d76ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:06.995565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd838d-d116-4ada-8889-68dd80d76ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:06.995848 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd838d-d116-4ada-8889-68dd80d76ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:06.996124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd838d-d116-4ada-8889-68dd80d76ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:06.996884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd838d-d116-4ada-8889-68dd80d76ce0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:06.997190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd838d-d116-4ada-8889-68dd80d76ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:06.998583 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd838d-d116-4ada-8889-68dd80d76ce0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:07.010778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 74/149] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:07.012090 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd838d-d116-4ada-8889-68dd80d76ce0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:07.029650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:07.113771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b43aa-4ee4-4785-b753-871bd0cefbff None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:07.144525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd838d-d116-4ada-8889-68dd80d76ce0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:07.185967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65076219-3e99-46b4-bc44-8b14def8f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:07.187140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076219-3e99-46b4-bc44-8b14def8f176 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:07.187637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076219-3e99-46b4-bc44-8b14def8f176 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:07.188105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65076219-3e99-46b4-bc44-8b14def8f176 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:07.200448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65076219-3e99-46b4-bc44-8b14def8f176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:07.208067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a2af-c381-4f71-932b-f6093b4a883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:07.208887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a2af-c381-4f71-932b-f6093b4a883c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:07.209172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a2af-c381-4f71-932b-f6093b4a883c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:07.209453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4a2af-c381-4f71-932b-f6093b4a883c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-65076219-3e99-46b4-bc44-8b14def8f176 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:07.210080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:07.210913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:07.211670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:07.214009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 75/150] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:07.215192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65076219-3e99-46b4-bc44-8b14def8f176 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:07.243509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c4a2af-c381-4f71-932b-f6093b4a883c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-64c4a2af-c381-4f71-932b-f6093b4a883c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:07.251348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:07.252227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:07.253623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 76/151] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:07.254268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a2af-c381-4f71-932b-f6093b4a883c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:07.307217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:07.311367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:07.330029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65076219-3e99-46b4-bc44-8b14def8f176 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:07.375029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc7b2-3620-423b-b4ac-70299c7fd1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:07.376314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc7b2-3620-423b-b4ac-70299c7fd1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:07.376802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc7b2-3620-423b-b4ac-70299c7fd1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:07.378099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fc7b2-3620-423b-b4ac-70299c7fd1c9 None admin] PATH_INFO: `/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:07.382192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fc7b2-3620-423b-b4ac-70299c7fd1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bbfccf210d4e55b6247a1a83e1dc0f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:07.384113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fc7b2-3620-423b-b4ac-70299c7fd1c9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:07.387344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 76/152] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:07 2022] GET /identity/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:07.389184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc7b2-3620-423b-b4ac-70299c7fd1c9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:07.459913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c4a2af-c381-4f71-932b-f6093b4a883c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:07.517255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0afab4-546e-4431-8573-418a3fdb2422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:07.519687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0afab4-546e-4431-8573-418a3fdb2422 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:07.520154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0afab4-546e-4431-8573-418a3fdb2422 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:07.520602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0afab4-546e-4431-8573-418a3fdb2422 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:07.521552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0afab4-546e-4431-8573-418a3fdb2422 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:07.522027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0afab4-546e-4431-8573-418a3fdb2422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:07.523943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0afab4-546e-4431-8573-418a3fdb2422 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:07.534522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 77/153] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:07.535586 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0afab4-546e-4431-8573-418a3fdb2422 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:07.649034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fc7b2-3620-423b-b4ac-70299c7fd1c9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:07.687222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:07.717282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0afab4-546e-4431-8573-418a3fdb2422 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:07.744518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196dea0-e1d9-4350-b626-c85d2d122b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:07.750745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196dea0-e1d9-4350-b626-c85d2d122b15 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:07.750745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196dea0-e1d9-4350-b626-c85d2d122b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:07.750745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196dea0-e1d9-4350-b626-c85d2d122b15 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:07.750745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196dea0-e1d9-4350-b626-c85d2d122b15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:07.750745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196dea0-e1d9-4350-b626-c85d2d122b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:07.750745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4196dea0-e1d9-4350-b626-c85d2d122b15 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:07.769401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 77/154] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:07.774163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c6bbd-67eb-44a1-82a7-22f6ab0c1f85 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:07.774464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c6bbd-67eb-44a1-82a7-22f6ab0c1f85 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:07.774751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c6bbd-67eb-44a1-82a7-22f6ab0c1f85 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:07.778226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 78/155] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:07.784911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c6bbd-67eb-44a1-82a7-22f6ab0c1f85 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:07.791932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:07.801013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3bcca-2216-4240-a05b-22c1670382e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:07.801700 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3bcca-2216-4240-a05b-22c1670382e5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:07.802029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3bcca-2216-4240-a05b-22c1670382e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:07.809848 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3bcca-2216-4240-a05b-22c1670382e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:07.895849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3bcca-2216-4240-a05b-22c1670382e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:07.897400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3bcca-2216-4240-a05b-22c1670382e5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:07.984524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c6bbd-67eb-44a1-82a7-22f6ab0c1f85 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:08.039752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1181bfb-d7fa-4d06-9056-53317fe5b6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:08.040647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1181bfb-d7fa-4d06-9056-53317fe5b6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:08.040930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1181bfb-d7fa-4d06-9056-53317fe5b6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:08.041210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1181bfb-d7fa-4d06-9056-53317fe5b6b1 None admin] PATH_INFO: `/v3/users/f8e5b4d849064820a77929db188df50b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:08.047580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1181bfb-d7fa-4d06-9056-53317fe5b6b1 None admin] RBAC: Authorizing `identity:get_user(user_id=f8e5b4d849064820a77929db188df50b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:08.049139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1181bfb-d7fa-4d06-9056-53317fe5b6b1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:08.051695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 79/156] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:07 2022] GET /identity/v3/users/f8e5b4d849064820a77929db188df50b => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:08.052489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1181bfb-d7fa-4d06-9056-53317fe5b6b1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:08.074517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:08.101109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 78/157] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:08.102472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f0797-b771-41e2-8d50-ee083bd3249b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:08.102766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f0797-b771-41e2-8d50-ee083bd3249b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:08.103070 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f0797-b771-41e2-8d50-ee083bd3249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:08.128828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6b4f0797-b771-41e2-8d50-ee083bd3249b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:08.130017 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6b4f0797-b771-41e2-8d50-ee083bd3249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:08.190524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:08.237144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1181bfb-d7fa-4d06-9056-53317fe5b6b1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:08.242582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 79/158] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:08.243657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f0797-b771-41e2-8d50-ee083bd3249b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:08.304396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd9039-6259-424a-a308-9a241ce72d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:08.305633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd9039-6259-424a-a308-9a241ce72d67 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:08.306249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd9039-6259-424a-a308-9a241ce72d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:08.307514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd9039-6259-424a-a308-9a241ce72d67 None admin] PATH_INFO: `/v3/users/03e5fefe8f3a4d94b7ee4b4f7c5d1df8` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:08.312686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd9039-6259-424a-a308-9a241ce72d67 None admin] RBAC: Authorizing `identity:get_user(user_id=03e5fefe8f3a4d94b7ee4b4f7c5d1df8)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:08.314353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd9039-6259-424a-a308-9a241ce72d67 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:08.319308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 80/159] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:08 2022] GET /identity/v3/users/03e5fefe8f3a4d94b7ee4b4f7c5d1df8 => generated 289 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:08.321475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd9039-6259-424a-a308-9a241ce72d67 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:08.428719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f0797-b771-41e2-8d50-ee083bd3249b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:08.433634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd9039-6259-424a-a308-9a241ce72d67 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:08.462505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:08.472234 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ef03d-627b-4873-8ecb-babff6368aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:08.473365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef03d-627b-4873-8ecb-babff6368aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:08.473866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef03d-627b-4873-8ecb-babff6368aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:08.474301 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ef03d-627b-4873-8ecb-babff6368aa9 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:08.475836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ef03d-627b-4873-8ecb-babff6368aa9 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:08.477496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ef03d-627b-4873-8ecb-babff6368aa9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:08.479447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 81/160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:08 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:08.480929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5dc3-e4a2-4232-88f9-c9c72829eed3 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:08.481444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5dc3-e4a2-4232-88f9-c9c72829eed3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:08.482204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa5dc3-e4a2-4232-88f9-c9c72829eed3 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:08.483675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 82/161] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:08.484562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa5dc3-e4a2-4232-88f9-c9c72829eed3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:08.501400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:08.504726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4f4b6-ed97-42c8-bbb8-9e1f8725112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:08.505703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4f4b6-ed97-42c8-bbb8-9e1f8725112b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:08.506270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4f4b6-ed97-42c8-bbb8-9e1f8725112b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:08.506890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4f4b6-ed97-42c8-bbb8-9e1f8725112b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:08.654255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa5dc3-e4a2-4232-88f9-c9c72829eed3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:08.655679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4f4b6-ed97-42c8-bbb8-9e1f8725112b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:08.657493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4f4b6-ed97-42c8-bbb8-9e1f8725112b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:08.693729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4fb5-25b8-4d8a-81fe-0cd09585c65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:08.695335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4fb5-25b8-4d8a-81fe-0cd09585c65a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:08.695619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4fb5-25b8-4d8a-81fe-0cd09585c65a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:08.695898 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e4fb5-25b8-4d8a-81fe-0cd09585c65a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:08.718115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e4fb5-25b8-4d8a-81fe-0cd09585c65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e39e4fb5-25b8-4d8a-81fe-0cd09585c65a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:08.739594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:08.740347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:08.741516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 83/162] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:08.741516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4fb5-25b8-4d8a-81fe-0cd09585c65a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:08.824619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:08.851294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 80/163] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:08.852327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4f4b6-ed97-42c8-bbb8-9e1f8725112b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:08.863298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e4fb5-25b8-4d8a-81fe-0cd09585c65a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:08.893611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:08.899900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a58c98-2f82-4e09-9e03-f82e019c147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:08.901047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a58c98-2f82-4e09-9e03-f82e019c147e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:08.901525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a58c98-2f82-4e09-9e03-f82e019c147e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:08.901988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a58c98-2f82-4e09-9e03-f82e019c147e None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:08.903435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a58c98-2f82-4e09-9e03-f82e019c147e None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:08.910713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a58c98-2f82-4e09-9e03-f82e019c147e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:08.910713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 84/164] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:08 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:08.910713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e93e87-c64e-4972-9f34-7053e29ad42f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:08.910713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e93e87-c64e-4972-9f34-7053e29ad42f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:08.910713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e93e87-c64e-4972-9f34-7053e29ad42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:08.932587 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-88e93e87-c64e-4972-9f34-7053e29ad42f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:08.934069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-88e93e87-c64e-4972-9f34-7053e29ad42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:09.007065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 85/165] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:09.008312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e93e87-c64e-4972-9f34-7053e29ad42f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:09.079883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:09.109356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4f4b6-ed97-42c8-bbb8-9e1f8725112b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:09.129689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e93e87-c64e-4972-9f34-7053e29ad42f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:09.167915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cdb33-230e-41b4-a460-768cfc0bf95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:09.169861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdb33-230e-41b4-a460-768cfc0bf95e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.170531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdb33-230e-41b4-a460-768cfc0bf95e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.171598 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdb33-230e-41b4-a460-768cfc0bf95e None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.172605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cdb33-230e-41b4-a460-768cfc0bf95e None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:09.173220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cdb33-230e-41b4-a460-768cfc0bf95e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:09.175995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cdb33-230e-41b4-a460-768cfc0bf95e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:09.188725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290c693-f45f-467e-880c-da87cbf0141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:09.189554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c693-f45f-467e-880c-da87cbf0141b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.190518 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c693-f45f-467e-880c-da87cbf0141b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.190976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290c693-f45f-467e-880c-da87cbf0141b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.191954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290c693-f45f-467e-880c-da87cbf0141b None admin] RBAC: Adding query filter params (role.id=67691f718ae34424ae84912841aee8df, scope.project.id=8867c613b3214d72b178a25b63c2e0af, user.id=d7bbfccf210d4e55b6247a1a83e1dc0f) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:09.192354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290c693-f45f-467e-880c-da87cbf0141b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:09.193358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 86/166] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:09.194061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290c693-f45f-467e-880c-da87cbf0141b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:09.194657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cdb33-230e-41b4-a460-768cfc0bf95e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:09.200997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 81/167] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:08 2022] GET /identity/v3/role_assignments?user.id=d7bbfccf210d4e55b6247a1a83e1dc0f&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=67691f718ae34424ae84912841aee8df => generated 608 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:09.201899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290c693-f45f-467e-880c-da87cbf0141b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:09.319155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cdb33-230e-41b4-a460-768cfc0bf95e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:09.320125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:09.341045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290c693-f45f-467e-880c-da87cbf0141b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:09.355725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:09.377475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d22841-149e-4401-90e3-73faa1233c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:09.379698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d22841-149e-4401-90e3-73faa1233c18 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.380919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d22841-149e-4401-90e3-73faa1233c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.381582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d22841-149e-4401-90e3-73faa1233c18 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.384456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d22841-149e-4401-90e3-73faa1233c18 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:09.387921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d22841-149e-4401-90e3-73faa1233c18 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:09.390164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 87/168] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:09 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:09.394135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d22841-149e-4401-90e3-73faa1233c18 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:09.413319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6be89-8ea7-4335-83b3-cd8539d9ee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:09.414698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6be89-8ea7-4335-83b3-cd8539d9ee8f None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.415237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6be89-8ea7-4335-83b3-cd8539d9ee8f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.415766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6be89-8ea7-4335-83b3-cd8539d9ee8f None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af/users/03e5fefe8f3a4d94b7ee4b4f7c5d1df8/roles/b6f66ee2ec664d738bf2a67e41decbc4` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.421325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6be89-8ea7-4335-83b3-cd8539d9ee8f None admin] RBAC: Authorizing `identity:create_grant(project_id=8867c613b3214d72b178a25b63c2e0af, user_id=03e5fefe8f3a4d94b7ee4b4f7c5d1df8, role_id=b6f66ee2ec664d738bf2a67e41decbc4)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:09.423208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6be89-8ea7-4335-83b3-cd8539d9ee8f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:09.505321 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 82/169] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:27:09 2022] PUT /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af/users/03e5fefe8f3a4d94b7ee4b4f7c5d1df8/roles/b6f66ee2ec664d738bf2a67e41decbc4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:09.506641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50670faa-100c-47cc-8d29-a4e791e0d6ff None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.507489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50670faa-100c-47cc-8d29-a4e791e0d6ff None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.507916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50670faa-100c-47cc-8d29-a4e791e0d6ff None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.509752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 83/170] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:09.510945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50670faa-100c-47cc-8d29-a4e791e0d6ff None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:09.528540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d22841-149e-4401-90e3-73faa1233c18 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:09.614175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb17c9c-0266-4ef4-9061-43df69283ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:09.616634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb17c9c-0266-4ef4-9061-43df69283ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.617071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb17c9c-0266-4ef4-9061-43df69283ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.618368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb17c9c-0266-4ef4-9061-43df69283ce1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.642267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb17c9c-0266-4ef4-9061-43df69283ce1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-6fb17c9c-0266-4ef4-9061-43df69283ce1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:09.654881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:09.656037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:09.657011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:09.664385 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 88/171] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:09.665235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb17c9c-0266-4ef4-9061-43df69283ce1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:09.751757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:09.754495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50670faa-100c-47cc-8d29-a4e791e0d6ff None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:09.796793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45fc44-8741-484e-8774-5dcb6eb23ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:09.797680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45fc44-8741-484e-8774-5dcb6eb23ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.797967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45fc44-8741-484e-8774-5dcb6eb23ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.798248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45fc44-8741-484e-8774-5dcb6eb23ac2 None admin] PATH_INFO: `/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.800139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45fc44-8741-484e-8774-5dcb6eb23ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bbfccf210d4e55b6247a1a83e1dc0f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:09.801786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45fc44-8741-484e-8774-5dcb6eb23ac2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:09.803492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 84/172] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:09 2022] GET /identity/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:09.804454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79492c-49e2-49e8-b109-3d6e695e22e2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.804927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79492c-49e2-49e8-b109-3d6e695e22e2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.805044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79492c-49e2-49e8-b109-3d6e695e22e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.807976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb17c9c-0266-4ef4-9061-43df69283ce1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:09.824148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7c79492c-49e2-49e8-b109-3d6e695e22e2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:09.825401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7c79492c-49e2-49e8-b109-3d6e695e22e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:09.829010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:09.844765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13b22-649f-428c-b212-c1df266b1e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:09.845487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13b22-649f-428c-b212-c1df266b1e83 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.845778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13b22-649f-428c-b212-c1df266b1e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.846695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a13b22-649f-428c-b212-c1df266b1e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.847746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a13b22-649f-428c-b212-c1df266b1e83 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=8867c613b3214d72b178a25b63c2e0af, user.id=f8e5b4d849064820a77929db188df50b) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:09.848008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a13b22-649f-428c-b212-c1df266b1e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:09.849580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a13b22-649f-428c-b212-c1df266b1e83 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:09.856013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 89/173] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:09 2022] GET /identity/v3/role_assignments?user.id=f8e5b4d849064820a77929db188df50b&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=9312183c32b04118985c8316f33f3830 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:09.856822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13b22-649f-428c-b212-c1df266b1e83 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:09.915587 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 85/174] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:09.918097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09171d40-68ea-4ce0-ab4d-9f0d9e4099c7 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.919117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09171d40-68ea-4ce0-ab4d-9f0d9e4099c7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.919612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09171d40-68ea-4ce0-ab4d-9f0d9e4099c7 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.921737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 86/175] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:09.923373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d122c8-52f8-4c80-8b93-9d79ebd4246d None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:09.923909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d122c8-52f8-4c80-8b93-9d79ebd4246d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:09.924411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d122c8-52f8-4c80-8b93-9d79ebd4246d None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:09.926562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 87/176] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:09.932609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d122c8-52f8-4c80-8b93-9d79ebd4246d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.002090 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a13b22-649f-428c-b212-c1df266b1e83 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.028414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.045024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27510879-811d-480a-bf4b-599b28258694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.046019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27510879-811d-480a-bf4b-599b28258694 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.046480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27510879-811d-480a-bf4b-599b28258694 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.046976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27510879-811d-480a-bf4b-599b28258694 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.047968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27510879-811d-480a-bf4b-599b28258694 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:10.048453 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27510879-811d-480a-bf4b-599b28258694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:10.050120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27510879-811d-480a-bf4b-599b28258694 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:10.060680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 90/177] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:10.062152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e153b-a7df-45bd-8006-ed12465a2dde None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.062448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e153b-a7df-45bd-8006-ed12465a2dde None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.062730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e153b-a7df-45bd-8006-ed12465a2dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.079182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d122c8-52f8-4c80-8b93-9d79ebd4246d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.080023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-859e153b-a7df-45bd-8006-ed12465a2dde None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:10.081836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-859e153b-a7df-45bd-8006-ed12465a2dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:10.132690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cc507-bd97-4627-acf8-b86cd6eb66df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.133265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cc507-bd97-4627-acf8-b86cd6eb66df None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.133549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cc507-bd97-4627-acf8-b86cd6eb66df None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.133828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cc507-bd97-4627-acf8-b86cd6eb66df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.149755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.165599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 91/178] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:10.167004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc364-0f14-40bb-8999-5cdc02d8a9ee None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.167296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc364-0f14-40bb-8999-5cdc02d8a9ee None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.167579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbc364-0f14-40bb-8999-5cdc02d8a9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.185463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4bfbc364-0f14-40bb-8999-5cdc02d8a9ee None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:10.186670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4bfbc364-0f14-40bb-8999-5cdc02d8a9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:10.229793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cc507-bd97-4627-acf8-b86cd6eb66df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:10.231318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cc507-bd97-4627-acf8-b86cd6eb66df None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:10.274978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 92/179] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:10.275824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc364-0f14-40bb-8999-5cdc02d8a9ee None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.336752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.352924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 88/180] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:10.353776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cc507-bd97-4627-acf8-b86cd6eb66df None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.399849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.403951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbc364-0f14-40bb-8999-5cdc02d8a9ee None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.444296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9cbe9-e8a1-4ccf-9c56-cd043b9d8c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.445089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9cbe9-e8a1-4ccf-9c56-cd043b9d8c9e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.445376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9cbe9-e8a1-4ccf-9c56-cd043b9d8c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.445654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9cbe9-e8a1-4ccf-9c56-cd043b9d8c9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.457411 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9cbe9-e8a1-4ccf-9c56-cd043b9d8c9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:10.461263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cc507-bd97-4627-acf8-b86cd6eb66df None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3de9cbe9-e8a1-4ccf-9c56-cd043b9d8c9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:10.465674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:10.466549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:10.467366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 93/181] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:10.473289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9cbe9-e8a1-4ccf-9c56-cd043b9d8c9e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.497380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c132a-97d6-4c37-b522-558e714b35a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.498254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c132a-97d6-4c37-b522-558e714b35a2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.498539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c132a-97d6-4c37-b522-558e714b35a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.498820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c132a-97d6-4c37-b522-558e714b35a2 None admin] PATH_INFO: `/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.500198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c132a-97d6-4c37-b522-558e714b35a2 None admin] RBAC: Authorizing `identity:get_user(user_id=d7bbfccf210d4e55b6247a1a83e1dc0f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:10.501703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c132a-97d6-4c37-b522-558e714b35a2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:10.508767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 89/182] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:10 2022] GET /identity/v3/users/d7bbfccf210d4e55b6247a1a83e1dc0f => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:10.508767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c132a-97d6-4c37-b522-558e714b35a2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.603470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9cbe9-e8a1-4ccf-9c56-cd043b9d8c9e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.605723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.615167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c132a-97d6-4c37-b522-558e714b35a2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.625313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.643907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadc636-4af8-4289-91a4-17df8c45476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.644725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadc636-4af8-4289-91a4-17df8c45476c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.645013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadc636-4af8-4289-91a4-17df8c45476c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.645346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aadc636-4af8-4289-91a4-17df8c45476c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.650294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8de62-360e-4631-8de1-b5ee26948336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.651047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8de62-360e-4631-8de1-b5ee26948336 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.651394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8de62-360e-4631-8de1-b5ee26948336 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.651613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8de62-360e-4631-8de1-b5ee26948336 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.652942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8de62-360e-4631-8de1-b5ee26948336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:10.655201 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8de62-360e-4631-8de1-b5ee26948336 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:10.656176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aadc636-4af8-4289-91a4-17df8c45476c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:10.656996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 90/183] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:10.662125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8de62-360e-4631-8de1-b5ee26948336 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-5aadc636-4af8-4289-91a4-17df8c45476c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:10.664500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:10.665372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:10.666170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:10.670403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 94/184] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:10.671254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadc636-4af8-4289-91a4-17df8c45476c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.775298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8de62-360e-4631-8de1-b5ee26948336 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.781353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aadc636-4af8-4289-91a4-17df8c45476c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.813784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1eeb-464f-49fc-952a-b04ae59b9ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.815522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1eeb-464f-49fc-952a-b04ae59b9ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.815961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1eeb-464f-49fc-952a-b04ae59b9ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.816571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b1eeb-464f-49fc-952a-b04ae59b9ec8 None admin] PATH_INFO: `/v3/projects/be7cdcc8bb6b4cc58739c4d277c2cbf7` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.817654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964d984-61d9-4e16-a51f-2d79d6a12594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.818107 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b1eeb-464f-49fc-952a-b04ae59b9ec8 None admin] RBAC: Authorizing `identity:get_project(project_id=be7cdcc8bb6b4cc58739c4d277c2cbf7)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:10.818324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964d984-61d9-4e16-a51f-2d79d6a12594 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.818611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964d984-61d9-4e16-a51f-2d79d6a12594 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.818916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964d984-61d9-4e16-a51f-2d79d6a12594 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.819670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964d984-61d9-4e16-a51f-2d79d6a12594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:10.819980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964d984-61d9-4e16-a51f-2d79d6a12594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:10.820524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b1eeb-464f-49fc-952a-b04ae59b9ec8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:10.821379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964d984-61d9-4e16-a51f-2d79d6a12594 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:10.822550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 91/185] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:10 2022] GET /identity/v3/projects/be7cdcc8bb6b4cc58739c4d277c2cbf7 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:10.823569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1eeb-464f-49fc-952a-b04ae59b9ec8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.838974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 95/186] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:10.840124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964d984-61d9-4e16-a51f-2d79d6a12594 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.868919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.880639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.933157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b1eeb-464f-49fc-952a-b04ae59b9ec8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.948614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964d984-61d9-4e16-a51f-2d79d6a12594 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.970205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a2b5-5469-464b-93c4-20435e0ce55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.970873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a2b5-5469-464b-93c4-20435e0ce55d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.971819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a2b5-5469-464b-93c4-20435e0ce55d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.971990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31a2b5-5469-464b-93c4-20435e0ce55d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.986518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159534-3de5-40eb-93d4-fc4f2791b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.987888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159534-3de5-40eb-93d4-fc4f2791b52f None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.988187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159534-3de5-40eb-93d4-fc4f2791b52f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.988466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159534-3de5-40eb-93d4-fc4f2791b52f None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.989193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159534-3de5-40eb-93d4-fc4f2791b52f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:10.990662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159534-3de5-40eb-93d4-fc4f2791b52f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:11.042646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a2b5-5469-464b-93c4-20435e0ce55d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:11.044145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31a2b5-5469-464b-93c4-20435e0ce55d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:11.069934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 96/187] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:10 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:11.070994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159534-3de5-40eb-93d4-fc4f2791b52f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:11.112573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:11.188165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 92/188] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:11.188165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a2b5-5469-464b-93c4-20435e0ce55d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:11.191271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:11.219399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159534-3de5-40eb-93d4-fc4f2791b52f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:11.270374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c47e0c-6aa8-4ba7-a320-113808d8de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:11.271089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c47e0c-6aa8-4ba7-a320-113808d8de1a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:11.271376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c47e0c-6aa8-4ba7-a320-113808d8de1a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:11.271656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c47e0c-6aa8-4ba7-a320-113808d8de1a None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:11.272426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c47e0c-6aa8-4ba7-a320-113808d8de1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:11.272738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c47e0c-6aa8-4ba7-a320-113808d8de1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:11.274131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c47e0c-6aa8-4ba7-a320-113808d8de1a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:11.287490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 97/189] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:11.287490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c47e0c-6aa8-4ba7-a320-113808d8de1a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:11.330286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31a2b5-5469-464b-93c4-20435e0ce55d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:11.377979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731125eb-26d0-40e2-82a6-eccb3225f4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:11.378752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731125eb-26d0-40e2-82a6-eccb3225f4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:11.379077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731125eb-26d0-40e2-82a6-eccb3225f4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:11.379362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731125eb-26d0-40e2-82a6-eccb3225f4c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:11.380327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731125eb-26d0-40e2-82a6-eccb3225f4c3 None admin] RBAC: Adding query filter params (role.id=67691f718ae34424ae84912841aee8df, scope.project.id=be7cdcc8bb6b4cc58739c4d277c2cbf7, user.id=d7bbfccf210d4e55b6247a1a83e1dc0f) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:11.380653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731125eb-26d0-40e2-82a6-eccb3225f4c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:11.382100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731125eb-26d0-40e2-82a6-eccb3225f4c3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:11.391638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 93/190] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:11 2022] GET /identity/v3/role_assignments?user.id=d7bbfccf210d4e55b6247a1a83e1dc0f&scope.project.id=be7cdcc8bb6b4cc58739c4d277c2cbf7&role.id=67691f718ae34424ae84912841aee8df => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:11.393900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731125eb-26d0-40e2-82a6-eccb3225f4c3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:11.409635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:11.423316 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c47e0c-6aa8-4ba7-a320-113808d8de1a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:11.481322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233f2a-acd3-4b64-b1bb-3bd5adf0b354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:11.482398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233f2a-acd3-4b64-b1bb-3bd5adf0b354 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:11.482680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233f2a-acd3-4b64-b1bb-3bd5adf0b354 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:11.483007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79233f2a-acd3-4b64-b1bb-3bd5adf0b354 None admin] PATH_INFO: `/v3/users/c6ac124917184586a1ae7bf277a67f43` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:11.500041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:11.506101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233f2a-acd3-4b64-b1bb-3bd5adf0b354 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ac124917184586a1ae7bf277a67f43)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:11.507748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79233f2a-acd3-4b64-b1bb-3bd5adf0b354 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:11.509669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 98/191] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:11 2022] GET /identity/v3/users/c6ac124917184586a1ae7bf277a67f43 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:11.510682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233f2a-acd3-4b64-b1bb-3bd5adf0b354 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:11.542550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731125eb-26d0-40e2-82a6-eccb3225f4c3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:11.597008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea5cec-c807-4ce5-9b78-e5f3e51dbda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:11.598739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea5cec-c807-4ce5-9b78-e5f3e51dbda7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:11.598739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea5cec-c807-4ce5-9b78-e5f3e51dbda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:11.598739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea5cec-c807-4ce5-9b78-e5f3e51dbda7 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:11.602604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea5cec-c807-4ce5-9b78-e5f3e51dbda7 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:11.604111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea5cec-c807-4ce5-9b78-e5f3e51dbda7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:11.605880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 94/192] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:11 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:11.608133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea5cec-c807-4ce5-9b78-e5f3e51dbda7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:11.651339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79233f2a-acd3-4b64-b1bb-3bd5adf0b354 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:11.694020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d12be-0cca-4a29-a291-d2bc82323cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:11.694627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d12be-0cca-4a29-a291-d2bc82323cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:11.694959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d12be-0cca-4a29-a291-d2bc82323cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:11.695244 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d12be-0cca-4a29-a291-d2bc82323cb1 None admin] PATH_INFO: `/v3/users/c6ac124917184586a1ae7bf277a67f43` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:11.696630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d12be-0cca-4a29-a291-d2bc82323cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ac124917184586a1ae7bf277a67f43)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:11.698114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d12be-0cca-4a29-a291-d2bc82323cb1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:11.700132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 99/193] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:11 2022] GET /identity/v3/users/c6ac124917184586a1ae7bf277a67f43 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:11.700913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d12be-0cca-4a29-a291-d2bc82323cb1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:11.719227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:11.757218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea5cec-c807-4ce5-9b78-e5f3e51dbda7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:11.807674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409a7c8-445a-479b-ba4a-75b293e58cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:11.808675 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409a7c8-445a-479b-ba4a-75b293e58cff None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:11.809008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409a7c8-445a-479b-ba4a-75b293e58cff None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:11.809291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409a7c8-445a-479b-ba4a-75b293e58cff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:11.839257 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:11.893906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d12be-0cca-4a29-a291-d2bc82323cb1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:11.898308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409a7c8-445a-479b-ba4a-75b293e58cff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:11.899831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409a7c8-445a-479b-ba4a-75b293e58cff None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:11.929929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fb528-b337-4eff-9527-c7ad37e68fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:11.930746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fb528-b337-4eff-9527-c7ad37e68fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:11.931177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fb528-b337-4eff-9527-c7ad37e68fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:11.931443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fb528-b337-4eff-9527-c7ad37e68fc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:11.932283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fb528-b337-4eff-9527-c7ad37e68fc0 None admin] RBAC: Adding query filter params (role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=8867c613b3214d72b178a25b63c2e0af, user.id=d7bbfccf210d4e55b6247a1a83e1dc0f) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:11.932604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fb528-b337-4eff-9527-c7ad37e68fc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:11.934309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fb528-b337-4eff-9527-c7ad37e68fc0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:11.946989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 100/194] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:11 2022] GET /identity/v3/role_assignments?user.id=d7bbfccf210d4e55b6247a1a83e1dc0f&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:11.948075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fb528-b337-4eff-9527-c7ad37e68fc0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:11.996637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:12.024761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 95/195] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:12.026424 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b483-3f42-4200-b3c0-c94f25d7ba4d None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:12.026778 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b483-3f42-4200-b3c0-c94f25d7ba4d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:12.027151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b9b483-3f42-4200-b3c0-c94f25d7ba4d None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:12.028799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 96/196] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:12.035104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9b483-3f42-4200-b3c0-c94f25d7ba4d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:12.154568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b9b483-3f42-4200-b3c0-c94f25d7ba4d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:12.200941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2af2c-3ded-4f9c-ba3c-228c637925d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:12.201817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2af2c-3ded-4f9c-ba3c-228c637925d5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:12.202106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2af2c-3ded-4f9c-ba3c-228c637925d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:12.202389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2af2c-3ded-4f9c-ba3c-228c637925d5 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:12.204900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2af2c-3ded-4f9c-ba3c-228c637925d5 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:12.206415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d2af2c-3ded-4f9c-ba3c-228c637925d5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:12.208232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 97/197] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:12 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:12.210188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5807f8-e859-418f-9799-90f730fc5bd3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:12.210493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5807f8-e859-418f-9799-90f730fc5bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:12.210776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5807f8-e859-418f-9799-90f730fc5bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:12.214570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fb528-b337-4eff-9527-c7ad37e68fc0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:12.233741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ae5807f8-e859-418f-9799-90f730fc5bd3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:12.234992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ae5807f8-e859-418f-9799-90f730fc5bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:12.259894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:12.266742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81270-4d19-4bd7-95ed-b2e4a3aeedac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:12.267708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81270-4d19-4bd7-95ed-b2e4a3aeedac None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:12.268276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81270-4d19-4bd7-95ed-b2e4a3aeedac None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:12.268749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f81270-4d19-4bd7-95ed-b2e4a3aeedac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:12.283496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:12.309685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 98/198] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:12.310623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5807f8-e859-418f-9799-90f730fc5bd3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:12.369870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f81270-4d19-4bd7-95ed-b2e4a3aeedac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:12.371526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f81270-4d19-4bd7-95ed-b2e4a3aeedac None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:12.426964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5807f8-e859-418f-9799-90f730fc5bd3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:12.470476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f9a6d-5347-45d0-8b4a-ad8e2c97db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:12.472169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f9a6d-5347-45d0-8b4a-ad8e2c97db0b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:12.472379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f9a6d-5347-45d0-8b4a-ad8e2c97db0b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:12.472560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f9a6d-5347-45d0-8b4a-ad8e2c97db0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:12.473673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f9a6d-5347-45d0-8b4a-ad8e2c97db0b None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=a82eabb094424b2fbf694476a02fb1cc, user.id=c6ac124917184586a1ae7bf277a67f43) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:12.474092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f9a6d-5347-45d0-8b4a-ad8e2c97db0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:12.475680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f9a6d-5347-45d0-8b4a-ad8e2c97db0b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:12.483695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 99/199] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:12 2022] GET /identity/v3/role_assignments?user.id=c6ac124917184586a1ae7bf277a67f43&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=9312183c32b04118985c8316f33f3830 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:12.484686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f9a6d-5347-45d0-8b4a-ad8e2c97db0b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:12.495273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 101/200] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:12.501340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81270-4d19-4bd7-95ed-b2e4a3aeedac None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:12.543215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:12.616113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:12.626044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f9a6d-5347-45d0-8b4a-ad8e2c97db0b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:12.668929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eeaf48-cb85-4c6e-8e67-df01dbb6f2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:12.669739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eeaf48-cb85-4c6e-8e67-df01dbb6f2fd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:12.670303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eeaf48-cb85-4c6e-8e67-df01dbb6f2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:12.670608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eeaf48-cb85-4c6e-8e67-df01dbb6f2fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:12.687162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eeaf48-cb85-4c6e-8e67-df01dbb6f2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-00eeaf48-cb85-4c6e-8e67-df01dbb6f2fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:12.697782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:12.698734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:12.699611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 100/201] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:12.706800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eeaf48-cb85-4c6e-8e67-df01dbb6f2fd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:12.731792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f81270-4d19-4bd7-95ed-b2e4a3aeedac None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:12.810274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35e0a-fb6c-43d1-b8e7-0336eb3ab3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:12.811525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35e0a-fb6c-43d1-b8e7-0336eb3ab3ff None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:12.812013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35e0a-fb6c-43d1-b8e7-0336eb3ab3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:12.812514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f35e0a-fb6c-43d1-b8e7-0336eb3ab3ff None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:12.814357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f35e0a-fb6c-43d1-b8e7-0336eb3ab3ff None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:12.816725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f35e0a-fb6c-43d1-b8e7-0336eb3ab3ff None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:12.818709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 102/202] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:12 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:12.822291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eeaf48-cb85-4c6e-8e67-df01dbb6f2fd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:12.832067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35e0a-fb6c-43d1-b8e7-0336eb3ab3ff None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:12.835268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:12.863094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d855d2-ca23-4bd0-a95b-3483025a95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:12.863894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d855d2-ca23-4bd0-a95b-3483025a95bf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:12.864189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d855d2-ca23-4bd0-a95b-3483025a95bf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:12.864474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d855d2-ca23-4bd0-a95b-3483025a95bf None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:12.865625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d855d2-ca23-4bd0-a95b-3483025a95bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:12.865951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d855d2-ca23-4bd0-a95b-3483025a95bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:12.867561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d855d2-ca23-4bd0-a95b-3483025a95bf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:12.878661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 101/203] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:12.884142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d855d2-ca23-4bd0-a95b-3483025a95bf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:12.989957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d855d2-ca23-4bd0-a95b-3483025a95bf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:13.025906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468a67f-ae77-4277-8ea4-10ed713b0322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:13.026792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468a67f-ae77-4277-8ea4-10ed713b0322 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:13.027111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468a67f-ae77-4277-8ea4-10ed713b0322 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:13.027392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468a67f-ae77-4277-8ea4-10ed713b0322 None admin] PATH_INFO: `/v3/users/03e5fefe8f3a4d94b7ee4b4f7c5d1df8` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:13.028617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468a67f-ae77-4277-8ea4-10ed713b0322 None admin] RBAC: Authorizing `identity:get_user(user_id=03e5fefe8f3a4d94b7ee4b4f7c5d1df8)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:13.030079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468a67f-ae77-4277-8ea4-10ed713b0322 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:13.031930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 102/204] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:12 2022] GET /identity/v3/users/03e5fefe8f3a4d94b7ee4b4f7c5d1df8 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:13.043815 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468a67f-ae77-4277-8ea4-10ed713b0322 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:13.058728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f35e0a-fb6c-43d1-b8e7-0336eb3ab3ff None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:13.071369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:13.096680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:13.120768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb826-1832-4dc2-ab3c-3bd50f9413c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:13.121434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb826-1832-4dc2-ab3c-3bd50f9413c7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:13.121720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb826-1832-4dc2-ab3c-3bd50f9413c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:13.122001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb826-1832-4dc2-ab3c-3bd50f9413c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:13.122852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eb826-1832-4dc2-ab3c-3bd50f9413c7 None admin] RBAC: Adding query filter params (role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=a82eabb094424b2fbf694476a02fb1cc, user.id=c6ac124917184586a1ae7bf277a67f43) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:13.123173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eb826-1832-4dc2-ab3c-3bd50f9413c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:13.124623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eb826-1832-4dc2-ab3c-3bd50f9413c7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:13.134697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 103/205] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:12 2022] GET /identity/v3/role_assignments?user.id=c6ac124917184586a1ae7bf277a67f43&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:13.217792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468a67f-ae77-4277-8ea4-10ed713b0322 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:13.272396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53d479-8405-4524-8762-b024127ac4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:13.273060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53d479-8405-4524-8762-b024127ac4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:13.273341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53d479-8405-4524-8762-b024127ac4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:13.273618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53d479-8405-4524-8762-b024127ac4b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:13.366516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53d479-8405-4524-8762-b024127ac4b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:13.367942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53d479-8405-4524-8762-b024127ac4b2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:13.407713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:13.494388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 103/206] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:13.499886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb826-1832-4dc2-ab3c-3bd50f9413c7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:13.603830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb826-1832-4dc2-ab3c-3bd50f9413c7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:13.661130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cead4-9b1f-4146-855d-b7acb450cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:13.661920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cead4-9b1f-4146-855d-b7acb450cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:13.662200 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cead4-9b1f-4146-855d-b7acb450cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:13.662473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cead4-9b1f-4146-855d-b7acb450cbc6 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:13.663702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cead4-9b1f-4146-855d-b7acb450cbc6 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:13.665169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cead4-9b1f-4146-855d-b7acb450cbc6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:13.667040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 104/207] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:13 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:13.672983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53d479-8405-4524-8762-b024127ac4b2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:13.791839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53d479-8405-4524-8762-b024127ac4b2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:13.799748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be4293-7028-48f5-8011-c5ea115cd94f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:13.800249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be4293-7028-48f5-8011-c5ea115cd94f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:13.800344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be4293-7028-48f5-8011-c5ea115cd94f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:13.801724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 105/208] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:13.808362 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34732983-f84b-4d0a-b02a-b68afc692ba7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:13.808653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34732983-f84b-4d0a-b02a-b68afc692ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:13.808932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34732983-f84b-4d0a-b02a-b68afc692ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:13.839213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:13.839842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-34732983-f84b-4d0a-b02a-b68afc692ba7 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:13.841063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-34732983-f84b-4d0a-b02a-b68afc692ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:13.856134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c290a-93f9-4b19-acf1-eebfa9e58e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:13.856805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c290a-93f9-4b19-acf1-eebfa9e58e49 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:13.857341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c290a-93f9-4b19-acf1-eebfa9e58e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:13.857632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c290a-93f9-4b19-acf1-eebfa9e58e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:13.858481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c290a-93f9-4b19-acf1-eebfa9e58e49 None admin] RBAC: Adding query filter params (role.id=b6f66ee2ec664d738bf2a67e41decbc4, scope.project.id=8867c613b3214d72b178a25b63c2e0af, user.id=03e5fefe8f3a4d94b7ee4b4f7c5d1df8) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:13.858825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c290a-93f9-4b19-acf1-eebfa9e58e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:13.860293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c290a-93f9-4b19-acf1-eebfa9e58e49 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:13.873996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 104/209] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:13 2022] GET /identity/v3/role_assignments?user.id=03e5fefe8f3a4d94b7ee4b4f7c5d1df8&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=b6f66ee2ec664d738bf2a67e41decbc4 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:13.897130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:13.946433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed47f9-592c-4aa8-af12-83a875c345db None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:13.946630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed47f9-592c-4aa8-af12-83a875c345db None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:13.946954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed47f9-592c-4aa8-af12-83a875c345db None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:13.948534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 105/210] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:13.964513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d323b-bc31-448a-9dbf-4bd07cb9d88a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:13.964829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d323b-bc31-448a-9dbf-4bd07cb9d88a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:13.965088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d323b-bc31-448a-9dbf-4bd07cb9d88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:13.980394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 106/211] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:13.996148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ac6d323b-bc31-448a-9dbf-4bd07cb9d88a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:13.997402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ac6d323b-bc31-448a-9dbf-4bd07cb9d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:14.044915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34732983-f84b-4d0a-b02a-b68afc692ba7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:14.092256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 106/212] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 09:27:14.118739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d323b-bc31-448a-9dbf-4bd07cb9d88a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:14.179567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34732983-f84b-4d0a-b02a-b68afc692ba7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:14.221014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52b196-ad75-4917-b364-d494f3a44bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:14.221973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b196-ad75-4917-b364-d494f3a44bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:14.222366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b196-ad75-4917-b364-d494f3a44bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:14.222712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52b196-ad75-4917-b364-d494f3a44bd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:14.225203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d323b-bc31-448a-9dbf-4bd07cb9d88a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:14.234275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52b196-ad75-4917-b364-d494f3a44bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-0f52b196-ad75-4917-b364-d494f3a44bd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:14.243395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:14.244345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:14.245156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 107/213] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:14.253052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52b196-ad75-4917-b364-d494f3a44bd2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:14.257334 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:14.274817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f93cc-9581-4275-8b60-0234feb9f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:14.279639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f93cc-9581-4275-8b60-0234feb9f0bc None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:14.279639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f93cc-9581-4275-8b60-0234feb9f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:14.279639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f93cc-9581-4275-8b60-0234feb9f0bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:14.279639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f93cc-9581-4275-8b60-0234feb9f0bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:14.279639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f93cc-9581-4275-8b60-0234feb9f0bc None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:14.281329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 107/214] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:14.286657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:14.287915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f93cc-9581-4275-8b60-0234feb9f0bc None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:14.369491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52b196-ad75-4917-b364-d494f3a44bd2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:14.391356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f93cc-9581-4275-8b60-0234feb9f0bc None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:14.405848 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5d80a-f870-4082-934f-55276e95e8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:14.406592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5d80a-f870-4082-934f-55276e95e8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:14.406906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5d80a-f870-4082-934f-55276e95e8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:14.407191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5d80a-f870-4082-934f-55276e95e8e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:14.407947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5d80a-f870-4082-934f-55276e95e8e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:14.408260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5d80a-f870-4082-934f-55276e95e8e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:14.410430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5d80a-f870-4082-934f-55276e95e8e5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:14.419724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 108/215] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:14.425751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5d80a-f870-4082-934f-55276e95e8e5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:14.427896 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e915c52-f6d2-4e95-aa03-10fba4e004c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:14.428565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e915c52-f6d2-4e95-aa03-10fba4e004c0 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:14.428855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e915c52-f6d2-4e95-aa03-10fba4e004c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:14.429138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e915c52-f6d2-4e95-aa03-10fba4e004c0 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:14.429874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e915c52-f6d2-4e95-aa03-10fba4e004c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:14.431374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e915c52-f6d2-4e95-aa03-10fba4e004c0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:14.516113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:14.531468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5d80a-f870-4082-934f-55276e95e8e5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:14.544499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 108/216] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:14 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:14.577162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47606fbe-36e9-4b16-82fb-80c58188b498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:14.578564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47606fbe-36e9-4b16-82fb-80c58188b498 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:14.579127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47606fbe-36e9-4b16-82fb-80c58188b498 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:14.579694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47606fbe-36e9-4b16-82fb-80c58188b498 None admin] PATH_INFO: `/v3/users/b10470dc00c842f19df9de8d3f1ef34e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:14.603991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47606fbe-36e9-4b16-82fb-80c58188b498 None admin] RBAC: Authorizing `identity:get_user(user_id=b10470dc00c842f19df9de8d3f1ef34e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:14.605532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47606fbe-36e9-4b16-82fb-80c58188b498 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:14.607818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 109/217] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:14 2022] GET /identity/v3/users/b10470dc00c842f19df9de8d3f1ef34e => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:14.614742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e915c52-f6d2-4e95-aa03-10fba4e004c0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:14.673199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:14.737422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e915c52-f6d2-4e95-aa03-10fba4e004c0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:14.773024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8bd8c-1011-4c91-b631-492cfc878d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:14.773604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8bd8c-1011-4c91-b631-492cfc878d60 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:14.773891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8bd8c-1011-4c91-b631-492cfc878d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:14.774204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8bd8c-1011-4c91-b631-492cfc878d60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:14.846547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8bd8c-1011-4c91-b631-492cfc878d60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:14.848060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8bd8c-1011-4c91-b631-492cfc878d60 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:14.897741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:14.957202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 109/218] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:14.962859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47606fbe-36e9-4b16-82fb-80c58188b498 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:15.022920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71e1d8-455d-4ef0-8784-8081559b5226 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:15.023298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71e1d8-455d-4ef0-8784-8081559b5226 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:15.023497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71e1d8-455d-4ef0-8784-8081559b5226 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:15.025019 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 110/219] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:15.031443 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26535f1-1b98-4f63-87bf-bdb71e3892ef None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:15.031684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26535f1-1b98-4f63-87bf-bdb71e3892ef None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:15.031950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26535f1-1b98-4f63-87bf-bdb71e3892ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:15.063895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f26535f1-1b98-4f63-87bf-bdb71e3892ef None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:15.065653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f26535f1-1b98-4f63-87bf-bdb71e3892ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:15.076325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47606fbe-36e9-4b16-82fb-80c58188b498 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:15.121470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d439-dad3-40c0-a176-b0180102c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:15.122750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d439-dad3-40c0-a176-b0180102c85f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:15.123065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d439-dad3-40c0-a176-b0180102c85f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:15.123664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d439-dad3-40c0-a176-b0180102c85f None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:15.125161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1d439-dad3-40c0-a176-b0180102c85f None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:15.127233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1d439-dad3-40c0-a176-b0180102c85f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:15.130188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 110/220] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:14 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:15.136670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d439-dad3-40c0-a176-b0180102c85f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:15.158756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:15.170633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 111/221] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:15.206680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26535f1-1b98-4f63-87bf-bdb71e3892ef None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:15.317790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d439-dad3-40c0-a176-b0180102c85f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:15.356867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:15.364178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2493-3fe1-4f2f-878b-e800dff72906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:15.364876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2493-3fe1-4f2f-878b-e800dff72906 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:15.395524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2493-3fe1-4f2f-878b-e800dff72906 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:15.395524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2493-3fe1-4f2f-878b-e800dff72906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:15.395524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2493-3fe1-4f2f-878b-e800dff72906 None admin] RBAC: Adding query filter params (role.id=67691f718ae34424ae84912841aee8df, scope.project.id=a82eabb094424b2fbf694476a02fb1cc, user.id=b10470dc00c842f19df9de8d3f1ef34e) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:15.395524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2493-3fe1-4f2f-878b-e800dff72906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:15.395524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2493-3fe1-4f2f-878b-e800dff72906 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:15.395918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 111/222] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:15 2022] GET /identity/v3/role_assignments?user.id=b10470dc00c842f19df9de8d3f1ef34e&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=67691f718ae34424ae84912841aee8df => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:15.406007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26535f1-1b98-4f63-87bf-bdb71e3892ef None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:15.460375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db452f-0dd4-4847-97bd-b09451338150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:15.461682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db452f-0dd4-4847-97bd-b09451338150 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:15.462173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db452f-0dd4-4847-97bd-b09451338150 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:15.462685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db452f-0dd4-4847-97bd-b09451338150 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:15.488932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db452f-0dd4-4847-97bd-b09451338150 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-24db452f-0dd4-4847-97bd-b09451338150 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:15.497626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:15.498548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:15.503923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:15.506325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 112/223] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:27:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:15.512445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2493-3fe1-4f2f-878b-e800dff72906 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:15.613963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:15.639891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2493-3fe1-4f2f-878b-e800dff72906 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:15.655709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274fddc-5a7b-4473-8f3d-cbe3e6a0bb07 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:15.656009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274fddc-5a7b-4473-8f3d-cbe3e6a0bb07 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:15.656267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274fddc-5a7b-4473-8f3d-cbe3e6a0bb07 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:15.657962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 113/224] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:15.663776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38785426-c82b-4163-98bf-781b48d48b4b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:15.664064 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38785426-c82b-4163-98bf-781b48d48b4b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:15.664347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38785426-c82b-4163-98bf-781b48d48b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:15.676586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42d8e-bf64-44da-b6ba-3bc240a1e210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:15.677269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42d8e-bf64-44da-b6ba-3bc240a1e210 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:15.677557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42d8e-bf64-44da-b6ba-3bc240a1e210 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:15.677840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c42d8e-bf64-44da-b6ba-3bc240a1e210 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:15.678602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c42d8e-bf64-44da-b6ba-3bc240a1e210 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:15.678943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c42d8e-bf64-44da-b6ba-3bc240a1e210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:15.680364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c42d8e-bf64-44da-b6ba-3bc240a1e210 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:15.684080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-38785426-c82b-4163-98bf-781b48d48b4b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:15.685372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-38785426-c82b-4163-98bf-781b48d48b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:15.689677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 112/225] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:15.695922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42d8e-bf64-44da-b6ba-3bc240a1e210 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:15.811306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c42d8e-bf64-44da-b6ba-3bc240a1e210 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:15.829386 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 114/226] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:15.865116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af9e0-ca0f-436c-ae32-e179c8257110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:15.865931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af9e0-ca0f-436c-ae32-e179c8257110 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:15.866218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af9e0-ca0f-436c-ae32-e179c8257110 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:15.866500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2af9e0-ca0f-436c-ae32-e179c8257110 None admin] PATH_INFO: `/v3/users/c6ac124917184586a1ae7bf277a67f43` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:15.867814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af9e0-ca0f-436c-ae32-e179c8257110 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ac124917184586a1ae7bf277a67f43)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:15.869272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2af9e0-ca0f-436c-ae32-e179c8257110 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:15.871946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 113/227] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:15 2022] GET /identity/v3/users/c6ac124917184586a1ae7bf277a67f43 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:15.876570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38785426-c82b-4163-98bf-781b48d48b4b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:15.908390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af9e0-ca0f-436c-ae32-e179c8257110 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:15.919192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:16.001308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:16.060758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38785426-c82b-4163-98bf-781b48d48b4b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:16.100023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd4866-1f69-4e43-9cbb-976ec0d2e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:16.101317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4866-1f69-4e43-9cbb-976ec0d2e462 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:16.101837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4866-1f69-4e43-9cbb-976ec0d2e462 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:16.102310 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd4866-1f69-4e43-9cbb-976ec0d2e462 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:16.103133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2af9e0-ca0f-436c-ae32-e179c8257110 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:16.104379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd4866-1f69-4e43-9cbb-976ec0d2e462 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:16.106291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd4866-1f69-4e43-9cbb-976ec0d2e462 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:16.108907 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 115/228] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:15 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:16.115433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd4866-1f69-4e43-9cbb-976ec0d2e462 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:16.168696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f55211-10d2-4bfd-a6c4-08c1e15afec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:16.169630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f55211-10d2-4bfd-a6c4-08c1e15afec9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:16.169920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f55211-10d2-4bfd-a6c4-08c1e15afec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:16.170197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f55211-10d2-4bfd-a6c4-08c1e15afec9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:16.191143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f55211-10d2-4bfd-a6c4-08c1e15afec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-20f55211-10d2-4bfd-a6c4-08c1e15afec9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:16.205822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:16.206723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:16.207543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:16.215357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 114/229] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:27:16.223865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f55211-10d2-4bfd-a6c4-08c1e15afec9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:16.226120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd4866-1f69-4e43-9cbb-976ec0d2e462 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:16.264085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec26894-62bc-4095-8f6e-5ecd98995c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:16.265421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec26894-62bc-4095-8f6e-5ecd98995c6a None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:16.265901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec26894-62bc-4095-8f6e-5ecd98995c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:16.266371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec26894-62bc-4095-8f6e-5ecd98995c6a None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc/users/c6ac124917184586a1ae7bf277a67f43/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:16.268963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec26894-62bc-4095-8f6e-5ecd98995c6a None admin] RBAC: Authorizing `identity:create_grant(project_id=a82eabb094424b2fbf694476a02fb1cc, user_id=c6ac124917184586a1ae7bf277a67f43, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:16.270773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec26894-62bc-4095-8f6e-5ecd98995c6a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:16.275156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:16.324217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:16.351024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 116/230] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:27:16 2022] PUT /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc/users/c6ac124917184586a1ae7bf277a67f43/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:27:16.375002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f55211-10d2-4bfd-a6c4-08c1e15afec9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:16.414232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6c3d0-fed9-46e6-b4f5-c062a6b1abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:16.415300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6c3d0-fed9-46e6-b4f5-c062a6b1abcc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:16.415876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6c3d0-fed9-46e6-b4f5-c062a6b1abcc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:16.416347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6c3d0-fed9-46e6-b4f5-c062a6b1abcc None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:16.417298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6c3d0-fed9-46e6-b4f5-c062a6b1abcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:16.417806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6c3d0-fed9-46e6-b4f5-c062a6b1abcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:16.419421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6c3d0-fed9-46e6-b4f5-c062a6b1abcc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:16.430289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 115/231] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:16.435945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec26894-62bc-4095-8f6e-5ecd98995c6a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:16.594978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec26894-62bc-4095-8f6e-5ecd98995c6a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:16.633943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec823287-6c5d-4d2e-ba94-f0262cc255bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:16.634753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec823287-6c5d-4d2e-ba94-f0262cc255bd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:16.635095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec823287-6c5d-4d2e-ba94-f0262cc255bd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:16.635377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec823287-6c5d-4d2e-ba94-f0262cc255bd None admin] PATH_INFO: `/v3/users/c6ac124917184586a1ae7bf277a67f43` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:16.636586 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec823287-6c5d-4d2e-ba94-f0262cc255bd None admin] RBAC: Authorizing `identity:get_user(user_id=c6ac124917184586a1ae7bf277a67f43)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:16.638077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec823287-6c5d-4d2e-ba94-f0262cc255bd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:16.640132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 117/232] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:16 2022] GET /identity/v3/users/c6ac124917184586a1ae7bf277a67f43 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:16.648184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6c3d0-fed9-46e6-b4f5-c062a6b1abcc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:16.774776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6c3d0-fed9-46e6-b4f5-c062a6b1abcc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:16.814680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:16.829942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f5480-730f-4511-9055-2e9b62555f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:16.831414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5480-730f-4511-9055-2e9b62555f75 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:16.831701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5480-730f-4511-9055-2e9b62555f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:16.831979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f5480-730f-4511-9055-2e9b62555f75 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:16.835588 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f5480-730f-4511-9055-2e9b62555f75 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:16.837065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f5480-730f-4511-9055-2e9b62555f75 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:16.838793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 116/233] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:16 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:16.844580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec823287-6c5d-4d2e-ba94-f0262cc255bd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:16.949495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:17.001589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec823287-6c5d-4d2e-ba94-f0262cc255bd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:17.048565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40300dff-2560-4cb2-83ff-d90cc4eeeee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:17.050018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40300dff-2560-4cb2-83ff-d90cc4eeeee4 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:17.050298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40300dff-2560-4cb2-83ff-d90cc4eeeee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:17.050561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40300dff-2560-4cb2-83ff-d90cc4eeeee4 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc/users/c6ac124917184586a1ae7bf277a67f43/roles/3aed2722fbf34ba2bb24b1cb29d49004` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:17.052845 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40300dff-2560-4cb2-83ff-d90cc4eeeee4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a82eabb094424b2fbf694476a02fb1cc, user_id=c6ac124917184586a1ae7bf277a67f43, role_id=3aed2722fbf34ba2bb24b1cb29d49004)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:17.054301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40300dff-2560-4cb2-83ff-d90cc4eeeee4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:17.190618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 118/234] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:27:16 2022] PUT /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc/users/c6ac124917184586a1ae7bf277a67f43/roles/3aed2722fbf34ba2bb24b1cb29d49004 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:17.240058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd5634-a90e-4f62-aad5-497308df0886 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:17.240549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd5634-a90e-4f62-aad5-497308df0886 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:17.240549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd5634-a90e-4f62-aad5-497308df0886 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:17.242131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 117/235] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:17.247517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71105229-1654-49c3-9778-89f870d71a6f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:17.247800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71105229-1654-49c3-9778-89f870d71a6f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:17.248081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71105229-1654-49c3-9778-89f870d71a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:17.272061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-71105229-1654-49c3-9778-89f870d71a6f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:17.273302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-71105229-1654-49c3-9778-89f870d71a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:17.380643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 119/236] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:17.408318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd5634-a90e-4f62-aad5-497308df0886 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:17.469916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ca21-9b51-4af2-9a8c-50228d7d2c8b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:17.470208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ca21-9b51-4af2-9a8c-50228d7d2c8b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:17.470482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968ca21-9b51-4af2-9a8c-50228d7d2c8b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:17.473010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 120/237] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:17.477997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0aa38-1af8-4f5d-b9a9-8df60ef20374 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:17.478287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0aa38-1af8-4f5d-b9a9-8df60ef20374 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:17.478572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0aa38-1af8-4f5d-b9a9-8df60ef20374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:17.507153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-14e0aa38-1af8-4f5d-b9a9-8df60ef20374 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:17.508267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-14e0aa38-1af8-4f5d-b9a9-8df60ef20374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:17.557476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd5634-a90e-4f62-aad5-497308df0886 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:17.594154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:17.613946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f028cd-e7ef-481d-8d32-ef754673601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:17.614749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f028cd-e7ef-481d-8d32-ef754673601c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:17.615061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f028cd-e7ef-481d-8d32-ef754673601c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:17.615337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f028cd-e7ef-481d-8d32-ef754673601c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:17.631161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 121/238] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:17.641920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f028cd-e7ef-481d-8d32-ef754673601c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-11f028cd-e7ef-481d-8d32-ef754673601c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:17.649679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:17.650574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:17.651367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 118/239] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:17.656992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0aa38-1af8-4f5d-b9a9-8df60ef20374 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:17.686654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f028cd-e7ef-481d-8d32-ef754673601c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:17.805804 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:17.850684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0aa38-1af8-4f5d-b9a9-8df60ef20374 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:17.907612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f028cd-e7ef-481d-8d32-ef754673601c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:17.921973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3216c-bbc9-4838-a022-b0c7ebabd691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:17.922650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3216c-bbc9-4838-a022-b0c7ebabd691 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:17.922961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3216c-bbc9-4838-a022-b0c7ebabd691 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:17.923240 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3216c-bbc9-4838-a022-b0c7ebabd691 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:17.923996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3216c-bbc9-4838-a022-b0c7ebabd691 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:17.926890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3216c-bbc9-4838-a022-b0c7ebabd691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:17.928306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3216c-bbc9-4838-a022-b0c7ebabd691 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:17.952017 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 122/240] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:17.953262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3216c-bbc9-4838-a022-b0c7ebabd691 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:17.986683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4a3af-b53c-4fdf-ad62-7c2e5f187cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:17.988758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4a3af-b53c-4fdf-ad62-7c2e5f187cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:17.989043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4a3af-b53c-4fdf-ad62-7c2e5f187cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:17.989319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4a3af-b53c-4fdf-ad62-7c2e5f187cb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:17.990519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4a3af-b53c-4fdf-ad62-7c2e5f187cb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:17.992238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e4a3af-b53c-4fdf-ad62-7c2e5f187cb2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:17.994178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 119/241] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:17.998636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e639-3897-4c09-8c88-d0ee1d9814f5 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:17.998636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e639-3897-4c09-8c88-d0ee1d9814f5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:17.998636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030e639-3897-4c09-8c88-d0ee1d9814f5 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:17.998636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 120/242] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:18.001831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030e639-3897-4c09-8c88-d0ee1d9814f5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:18.019705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:18.077981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3216c-bbc9-4838-a022-b0c7ebabd691 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:18.117535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f22359-0b4f-46d9-8db9-b61298849736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:18.118519 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f22359-0b4f-46d9-8db9-b61298849736 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:18.130868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f22359-0b4f-46d9-8db9-b61298849736 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:18.130868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f22359-0b4f-46d9-8db9-b61298849736 None admin] PATH_INFO: `/v3/users/adff37efef9a4f65812e53d18d449f94` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:18.131074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030e639-3897-4c09-8c88-d0ee1d9814f5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:18.137184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f22359-0b4f-46d9-8db9-b61298849736 None admin] RBAC: Authorizing `identity:get_user(user_id=adff37efef9a4f65812e53d18d449f94)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:18.139006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f22359-0b4f-46d9-8db9-b61298849736 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:18.146068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 123/243] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:17 2022] GET /identity/v3/users/adff37efef9a4f65812e53d18d449f94 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:18.146527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:18.148312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57478d6-49e3-464f-bb04-d4a8f59ef4df None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:18.148671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57478d6-49e3-464f-bb04-d4a8f59ef4df None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:18.149011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57478d6-49e3-464f-bb04-d4a8f59ef4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:18.156634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac09c0-36ad-4260-9a36-b42dfb646c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:18.157310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac09c0-36ad-4260-9a36-b42dfb646c1e None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:18.157598 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac09c0-36ad-4260-9a36-b42dfb646c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:18.157877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac09c0-36ad-4260-9a36-b42dfb646c1e None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:18.158678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac09c0-36ad-4260-9a36-b42dfb646c1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:18.160309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac09c0-36ad-4260-9a36-b42dfb646c1e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:18.167950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f57478d6-49e3-464f-bb04-d4a8f59ef4df None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:18.169237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f57478d6-49e3-464f-bb04-d4a8f59ef4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:18.241016 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 124/244] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:18.247618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57478d6-49e3-464f-bb04-d4a8f59ef4df None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:18.248523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 121/245] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:18 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:18.273255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac09c0-36ad-4260-9a36-b42dfb646c1e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:18.312535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:18.405415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac09c0-36ad-4260-9a36-b42dfb646c1e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:18.449112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8bdc7-3cea-4b43-892d-00500d0bb1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:18.449929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8bdc7-3cea-4b43-892d-00500d0bb1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:18.450216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8bdc7-3cea-4b43-892d-00500d0bb1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:18.450494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8bdc7-3cea-4b43-892d-00500d0bb1c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:18.465253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8bdc7-3cea-4b43-892d-00500d0bb1c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:18.467472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57478d6-49e3-464f-bb04-d4a8f59ef4df None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-0cf8bdc7-3cea-4b43-892d-00500d0bb1c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:18.475509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:18.477500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:18.479450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 122/246] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:18.484342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8bdc7-3cea-4b43-892d-00500d0bb1c3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:18.517209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13d1f1-4252-405c-b3a6-97a509e0d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:18.518773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13d1f1-4252-405c-b3a6-97a509e0d2ef None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:18.519992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13d1f1-4252-405c-b3a6-97a509e0d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:18.520119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13d1f1-4252-405c-b3a6-97a509e0d2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:18.550484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:18.610761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13d1f1-4252-405c-b3a6-97a509e0d2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:18.613274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13d1f1-4252-405c-b3a6-97a509e0d2ef None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:18.636703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8bdc7-3cea-4b43-892d-00500d0bb1c3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:18.656612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:18.682766 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee42688-7706-4aa3-8c51-9d8d4ec12f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:18.684081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee42688-7706-4aa3-8c51-9d8d4ec12f4f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:18.684733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee42688-7706-4aa3-8c51-9d8d4ec12f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:18.685212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee42688-7706-4aa3-8c51-9d8d4ec12f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:18.686613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee42688-7706-4aa3-8c51-9d8d4ec12f4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:18.687235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee42688-7706-4aa3-8c51-9d8d4ec12f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:18.688826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee42688-7706-4aa3-8c51-9d8d4ec12f4f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:18.700401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 123/247] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:18.706801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee42688-7706-4aa3-8c51-9d8d4ec12f4f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:18.745824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 125/248] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:18.756011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13d1f1-4252-405c-b3a6-97a509e0d2ef None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:18.821471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:18.824633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee42688-7706-4aa3-8c51-9d8d4ec12f4f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:18.863146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402a50-b4de-4ba1-aa47-94ff70e93a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:18.864031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402a50-b4de-4ba1-aa47-94ff70e93a76 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:18.864315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402a50-b4de-4ba1-aa47-94ff70e93a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:18.864592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402a50-b4de-4ba1-aa47-94ff70e93a76 None admin] PATH_INFO: `/v3/users/b10470dc00c842f19df9de8d3f1ef34e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:18.865384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13d1f1-4252-405c-b3a6-97a509e0d2ef None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:18.865819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402a50-b4de-4ba1-aa47-94ff70e93a76 None admin] RBAC: Authorizing `identity:get_user(user_id=b10470dc00c842f19df9de8d3f1ef34e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:18.867306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402a50-b4de-4ba1-aa47-94ff70e93a76 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:18.869262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 124/249] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:18 2022] GET /identity/v3/users/b10470dc00c842f19df9de8d3f1ef34e => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:18.881916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402a50-b4de-4ba1-aa47-94ff70e93a76 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:18.905891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:18.913917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf704a4-dcac-49ca-bae0-dda07c398616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:18.915031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf704a4-dcac-49ca-bae0-dda07c398616 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:18.915317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf704a4-dcac-49ca-bae0-dda07c398616 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:18.915771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf704a4-dcac-49ca-bae0-dda07c398616 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:18.924666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf704a4-dcac-49ca-bae0-dda07c398616 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:18.924666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf704a4-dcac-49ca-bae0-dda07c398616 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:18.924666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 126/250] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:18 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:18.928220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf704a4-dcac-49ca-bae0-dda07c398616 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:19.020394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402a50-b4de-4ba1-aa47-94ff70e93a76 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:19.052205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf704a4-dcac-49ca-bae0-dda07c398616 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:19.069684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8b6f4-6884-4544-89cd-e6016f2c4848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:19.070554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8b6f4-6884-4544-89cd-e6016f2c4848 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:19.070866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8b6f4-6884-4544-89cd-e6016f2c4848 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:19.071146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8b6f4-6884-4544-89cd-e6016f2c4848 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:19.072347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8b6f4-6884-4544-89cd-e6016f2c4848 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:19.073808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8b6f4-6884-4544-89cd-e6016f2c4848 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:19.075829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 125/251] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:18 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:19.077044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04fb0-4e85-4bd3-9b6c-780ad53b4056 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:19.077319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04fb0-4e85-4bd3-9b6c-780ad53b4056 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:19.077600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04fb0-4e85-4bd3-9b6c-780ad53b4056 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:19.079101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 126/252] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:19.086233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e33cb-393f-4bda-9efd-2a5fd74802e9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:19.086514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e33cb-393f-4bda-9efd-2a5fd74802e9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:19.086788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e33cb-393f-4bda-9efd-2a5fd74802e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:19.113498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b01e33cb-393f-4bda-9efd-2a5fd74802e9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:19.114703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b01e33cb-393f-4bda-9efd-2a5fd74802e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:19.119216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899b10e-c8a7-48cf-af15-a7f188313510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:19.119880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899b10e-c8a7-48cf-af15-a7f188313510 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:19.120161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899b10e-c8a7-48cf-af15-a7f188313510 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:19.120436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899b10e-c8a7-48cf-af15-a7f188313510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:19.121277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899b10e-c8a7-48cf-af15-a7f188313510 None admin] RBAC: Adding query filter params (role.id=b6f66ee2ec664d738bf2a67e41decbc4, scope.project.id=a82eabb094424b2fbf694476a02fb1cc, user.id=adff37efef9a4f65812e53d18d449f94) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:19.121590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899b10e-c8a7-48cf-af15-a7f188313510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:19.123056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899b10e-c8a7-48cf-af15-a7f188313510 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:19.136844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 127/253] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:18 2022] GET /identity/v3/role_assignments?user.id=adff37efef9a4f65812e53d18d449f94&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=b6f66ee2ec664d738bf2a67e41decbc4 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:19.137690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899b10e-c8a7-48cf-af15-a7f188313510 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:19.191985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:19.264900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 127/254] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:19.291482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:19.305053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e33cb-393f-4bda-9efd-2a5fd74802e9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:19.342732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899b10e-c8a7-48cf-af15-a7f188313510 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:19.384988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100c6bf-1c07-43d7-b111-77c9e02527bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:19.385899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100c6bf-1c07-43d7-b111-77c9e02527bb None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:19.386187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100c6bf-1c07-43d7-b111-77c9e02527bb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:19.386469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100c6bf-1c07-43d7-b111-77c9e02527bb None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc/users/b10470dc00c842f19df9de8d3f1ef34e/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:19.390249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100c6bf-1c07-43d7-b111-77c9e02527bb None admin] RBAC: Authorizing `identity:create_grant(project_id=a82eabb094424b2fbf694476a02fb1cc, user_id=b10470dc00c842f19df9de8d3f1ef34e, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:19.391764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100c6bf-1c07-43d7-b111-77c9e02527bb None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:19.486240 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 128/255] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:27:19 2022] PUT /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc/users/b10470dc00c842f19df9de8d3f1ef34e/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:19.510006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e33cb-393f-4bda-9efd-2a5fd74802e9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:19.567123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05ccb2-1865-4c6b-b99e-7609c2df7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:19.568191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05ccb2-1865-4c6b-b99e-7609c2df7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:19.568478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05ccb2-1865-4c6b-b99e-7609c2df7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:19.568753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05ccb2-1865-4c6b-b99e-7609c2df7dc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:19.597933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05ccb2-1865-4c6b-b99e-7609c2df7dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-cd05ccb2-1865-4c6b-b99e-7609c2df7dc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:19.605931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:19.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:19.608023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:19.615766 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 128/256] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:27:19.621640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100c6bf-1c07-43d7-b111-77c9e02527bb None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:19.732736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3a572-abfa-4cd2-bd85-5a1267629e88 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:19.733021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3a572-abfa-4cd2-bd85-5a1267629e88 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:19.733509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3a572-abfa-4cd2-bd85-5a1267629e88 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:19.735040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 129/257] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:19.741568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e2e97-5daf-4fa4-aca7-7d82fb00902d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:19.742160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e2e97-5daf-4fa4-aca7-7d82fb00902d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:19.742647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e2e97-5daf-4fa4-aca7-7d82fb00902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:19.766270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100c6bf-1c07-43d7-b111-77c9e02527bb None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:19.791735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fb9e2e97-5daf-4fa4-aca7-7d82fb00902d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:19.793321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fb9e2e97-5daf-4fa4-aca7-7d82fb00902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:19.830212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:19.830784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:19.851728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38c10d-8c1d-4ef5-9145-40aad8aa5df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:19.852479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38c10d-8c1d-4ef5-9145-40aad8aa5df4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:19.852801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38c10d-8c1d-4ef5-9145-40aad8aa5df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:19.853058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38c10d-8c1d-4ef5-9145-40aad8aa5df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:19.853833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38c10d-8c1d-4ef5-9145-40aad8aa5df4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:19.854147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38c10d-8c1d-4ef5-9145-40aad8aa5df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:19.855597 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38c10d-8c1d-4ef5-9145-40aad8aa5df4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:19.870485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 129/258] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:19.889357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38c10d-8c1d-4ef5-9145-40aad8aa5df4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:19.920885 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 130/259] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:19.995411 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e2e97-5daf-4fa4-aca7-7d82fb00902d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:20.049175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38c10d-8c1d-4ef5-9145-40aad8aa5df4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:20.134537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba4b5e-db45-433d-8f98-b189ac0e5824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:20.135702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba4b5e-db45-433d-8f98-b189ac0e5824 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:20.136134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba4b5e-db45-433d-8f98-b189ac0e5824 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:20.136554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba4b5e-db45-433d-8f98-b189ac0e5824 None admin] PATH_INFO: `/v3/users/c6ac124917184586a1ae7bf277a67f43` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:20.143637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba4b5e-db45-433d-8f98-b189ac0e5824 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ac124917184586a1ae7bf277a67f43)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:20.145293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba4b5e-db45-433d-8f98-b189ac0e5824 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:20.147166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 130/260] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:19 2022] GET /identity/v3/users/c6ac124917184586a1ae7bf277a67f43 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:20.152637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba4b5e-db45-433d-8f98-b189ac0e5824 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:20.182536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e2e97-5daf-4fa4-aca7-7d82fb00902d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:20.269770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:20.275569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5be14-d4e3-45e4-8a2b-72924d836bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:20.276410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5be14-d4e3-45e4-8a2b-72924d836bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:20.276699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5be14-d4e3-45e4-8a2b-72924d836bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:20.276976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5be14-d4e3-45e4-8a2b-72924d836bb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:20.307754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5be14-d4e3-45e4-8a2b-72924d836bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-63f5be14-d4e3-45e4-8a2b-72924d836bb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:20.316649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:20.317840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:20.318751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:20.323706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 131/261] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:27:20.329116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5be14-d4e3-45e4-8a2b-72924d836bb7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:20.370338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:20.370915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba4b5e-db45-433d-8f98-b189ac0e5824 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:20.436580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3d6d2-654d-44d7-9b10-85c17d614de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:20.437243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3d6d2-654d-44d7-9b10-85c17d614de4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:20.437534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3d6d2-654d-44d7-9b10-85c17d614de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:20.437814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3d6d2-654d-44d7-9b10-85c17d614de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:20.568575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5be14-d4e3-45e4-8a2b-72924d836bb7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:20.638111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee1b77-881b-4374-9bfd-9cfa63986b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:20.639186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee1b77-881b-4374-9bfd-9cfa63986b21 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:20.639678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee1b77-881b-4374-9bfd-9cfa63986b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:20.640180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee1b77-881b-4374-9bfd-9cfa63986b21 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:20.641155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee1b77-881b-4374-9bfd-9cfa63986b21 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:20.641664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee1b77-881b-4374-9bfd-9cfa63986b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:20.643857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee1b77-881b-4374-9bfd-9cfa63986b21 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:20.662764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 132/262] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:20.667703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3d6d2-654d-44d7-9b10-85c17d614de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:20.669198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3d6d2-654d-44d7-9b10-85c17d614de4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:20.674116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee1b77-881b-4374-9bfd-9cfa63986b21 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:20.813717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:20.816053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:20.840979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee1b77-881b-4374-9bfd-9cfa63986b21 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:20.918907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61ba9c-8379-4c42-8a3b-5bd0cb281b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:20.919792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ba9c-8379-4c42-8a3b-5bd0cb281b7e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:20.920080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ba9c-8379-4c42-8a3b-5bd0cb281b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:20.920383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61ba9c-8379-4c42-8a3b-5bd0cb281b7e None admin] PATH_INFO: `/v3/users/c6ac124917184586a1ae7bf277a67f43` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:20.923574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61ba9c-8379-4c42-8a3b-5bd0cb281b7e None admin] RBAC: Authorizing `identity:get_user(user_id=c6ac124917184586a1ae7bf277a67f43)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:20.923712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 131/263] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 771 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 09:27:20.925260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61ba9c-8379-4c42-8a3b-5bd0cb281b7e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:20.927185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 133/264] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:20 2022] GET /identity/v3/users/c6ac124917184586a1ae7bf277a67f43 => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:20.932241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3d6d2-654d-44d7-9b10-85c17d614de4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:20.932548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61ba9c-8379-4c42-8a3b-5bd0cb281b7e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:21.084726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3d6d2-654d-44d7-9b10-85c17d614de4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:21.103046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61ba9c-8379-4c42-8a3b-5bd0cb281b7e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:21.130676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8062e3-0050-417e-90f9-f3bb70c0f7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:21.133159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8062e3-0050-417e-90f9-f3bb70c0f7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:21.133653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8062e3-0050-417e-90f9-f3bb70c0f7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:21.134178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8062e3-0050-417e-90f9-f3bb70c0f7a7 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:21.135608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8062e3-0050-417e-90f9-f3bb70c0f7a7 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:21.137262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8062e3-0050-417e-90f9-f3bb70c0f7a7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:21.139254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 132/265] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:20 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:21.147545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8062e3-0050-417e-90f9-f3bb70c0f7a7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:21.188118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74ea8d-fb1b-48b9-a577-c1369fb555ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:21.188780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74ea8d-fb1b-48b9-a577-c1369fb555ce None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:21.189068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74ea8d-fb1b-48b9-a577-c1369fb555ce None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:21.189346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74ea8d-fb1b-48b9-a577-c1369fb555ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:21.192775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:21.233881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:21.376041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74ea8d-fb1b-48b9-a577-c1369fb555ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:21.377506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74ea8d-fb1b-48b9-a577-c1369fb555ce None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:21.405540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8062e3-0050-417e-90f9-f3bb70c0f7a7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:21.480910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a6a66-ee3d-4ba5-9e09-f9e8a1e4f535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:21.481584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6a66-ee3d-4ba5-9e09-f9e8a1e4f535 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:21.481870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6a66-ee3d-4ba5-9e09-f9e8a1e4f535 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:21.482150 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a6a66-ee3d-4ba5-9e09-f9e8a1e4f535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:21.483286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a6a66-ee3d-4ba5-9e09-f9e8a1e4f535 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=a82eabb094424b2fbf694476a02fb1cc, user.id=c6ac124917184586a1ae7bf277a67f43) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:21.483600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a6a66-ee3d-4ba5-9e09-f9e8a1e4f535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:21.485122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a6a66-ee3d-4ba5-9e09-f9e8a1e4f535 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:21.499335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 133/266] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:21 2022] GET /identity/v3/role_assignments?user.id=c6ac124917184586a1ae7bf277a67f43&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=9312183c32b04118985c8316f33f3830 => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:21.536068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 134/267] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 09:27:21.541674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a6a66-ee3d-4ba5-9e09-f9e8a1e4f535 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:21.659139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:21.679531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a6a66-ee3d-4ba5-9e09-f9e8a1e4f535 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:21.718775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b3bed-ae1b-4f4b-90d9-5b6bfd17b590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:21.719694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b3bed-ae1b-4f4b-90d9-5b6bfd17b590 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:21.719988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b3bed-ae1b-4f4b-90d9-5b6bfd17b590 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:21.720265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b3bed-ae1b-4f4b-90d9-5b6bfd17b590 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:21.727612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b3bed-ae1b-4f4b-90d9-5b6bfd17b590 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:21.729129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b3bed-ae1b-4f4b-90d9-5b6bfd17b590 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:21.730894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 134/268] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:21 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:21.737351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74ea8d-fb1b-48b9-a577-c1369fb555ce None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:21.800214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:21.862892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74ea8d-fb1b-48b9-a577-c1369fb555ce None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:21.907703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e3de5-d5c8-4aea-9b35-065132dee7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:21.909543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3de5-d5c8-4aea-9b35-065132dee7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:21.910143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3de5-d5c8-4aea-9b35-065132dee7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:21.910648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e3de5-d5c8-4aea-9b35-065132dee7c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:21.911746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e3de5-d5c8-4aea-9b35-065132dee7c3 None admin] RBAC: Adding query filter params (role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=a82eabb094424b2fbf694476a02fb1cc, user.id=c6ac124917184586a1ae7bf277a67f43) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:21.912269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e3de5-d5c8-4aea-9b35-065132dee7c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:21.913957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0e3de5-d5c8-4aea-9b35-065132dee7c3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:21.921755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ac1ed-b388-47e1-aecd-16e51cb91b5b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:21.922092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 135/269] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:21 2022] GET /identity/v3/role_assignments?user.id=c6ac124917184586a1ae7bf277a67f43&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:21.926874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ac1ed-b388-47e1-aecd-16e51cb91b5b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:21.926874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ac1ed-b388-47e1-aecd-16e51cb91b5b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:21.926874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 135/270] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:21.931675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce7f45-5866-4ff2-9d0f-c4be0dedfcb0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:21.932335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce7f45-5866-4ff2-9d0f-c4be0dedfcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:21.932817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce7f45-5866-4ff2-9d0f-c4be0dedfcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:21.958586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-74ce7f45-5866-4ff2-9d0f-c4be0dedfcb0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:21.960286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-74ce7f45-5866-4ff2-9d0f-c4be0dedfcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:21.998895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c60924-37e9-4a05-a63c-09ee645e7beb None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:21.998895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c60924-37e9-4a05-a63c-09ee645e7beb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:21.998895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c60924-37e9-4a05-a63c-09ee645e7beb None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:21.998895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 136/271] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:22.005154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256bc1-4cd9-40e6-880f-df07e9aed272 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.005357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256bc1-4cd9-40e6-880f-df07e9aed272 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.005618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85256bc1-4cd9-40e6-880f-df07e9aed272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.053807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-85256bc1-4cd9-40e6-880f-df07e9aed272 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:22.053807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-85256bc1-4cd9-40e6-880f-df07e9aed272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:22.057083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 136/272] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:22.101976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce7f45-5866-4ff2-9d0f-c4be0dedfcb0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:22.146456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 137/273] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:22.147954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dfe21-ccb6-4155-98c8-92a2462d9fdb None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.148246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dfe21-ccb6-4155-98c8-92a2462d9fdb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.148524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dfe21-ccb6-4155-98c8-92a2462d9fdb None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.150044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 138/274] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:22.162381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:22.172954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317d4e-17e8-4591-b5d3-74d8b881e278 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.173236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317d4e-17e8-4591-b5d3-74d8b881e278 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.177703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317d4e-17e8-4591-b5d3-74d8b881e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.192082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-32317d4e-17e8-4591-b5d3-74d8b881e278 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:22.193270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-32317d4e-17e8-4591-b5d3-74d8b881e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:22.232212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce7f45-5866-4ff2-9d0f-c4be0dedfcb0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:22.279194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 139/275] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:22.280216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317d4e-17e8-4591-b5d3-74d8b881e278 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:22.293136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5286ea4-e681-412c-8859-3f78f143a9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:22.294480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5286ea4-e681-412c-8859-3f78f143a9dc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.294818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5286ea4-e681-412c-8859-3f78f143a9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.295134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5286ea4-e681-412c-8859-3f78f143a9dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.298643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:22.311188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5286ea4-e681-412c-8859-3f78f143a9dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a5286ea4-e681-412c-8859-3f78f143a9dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:22.319145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:22.320116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:22.320928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:22.327608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 137/276] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:27:22.328995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5286ea4-e681-412c-8859-3f78f143a9dc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:22.391393 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317d4e-17e8-4591-b5d3-74d8b881e278 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:22.432096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b05878-98dc-4ca2-a89f-cab528554673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:22.432817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b05878-98dc-4ca2-a89f-cab528554673 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.433095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b05878-98dc-4ca2-a89f-cab528554673 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.433378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b05878-98dc-4ca2-a89f-cab528554673 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.434538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b05878-98dc-4ca2-a89f-cab528554673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:22.436063 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b05878-98dc-4ca2-a89f-cab528554673 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:22.437090 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:22.437691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 140/277] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:22.440310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5286ea4-e681-412c-8859-3f78f143a9dc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:22.442938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b05878-98dc-4ca2-a89f-cab528554673 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:22.478377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c55998-5580-4b1c-af46-0ef06817089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:22.479296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c55998-5580-4b1c-af46-0ef06817089c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.479578 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c55998-5580-4b1c-af46-0ef06817089c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.479855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c55998-5580-4b1c-af46-0ef06817089c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.491467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c55998-5580-4b1c-af46-0ef06817089c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-16c55998-5580-4b1c-af46-0ef06817089c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:22.501187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:22.502087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:22.503813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:22.504893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 138/278] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:22.505243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c55998-5580-4b1c-af46-0ef06817089c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:22.532218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:22.549635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b05878-98dc-4ca2-a89f-cab528554673 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:22.583604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da72bf-e648-4e5f-83dc-1fb6cef960b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:22.584275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da72bf-e648-4e5f-83dc-1fb6cef960b9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.584562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da72bf-e648-4e5f-83dc-1fb6cef960b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.584840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da72bf-e648-4e5f-83dc-1fb6cef960b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.585592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da72bf-e648-4e5f-83dc-1fb6cef960b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:22.585898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da72bf-e648-4e5f-83dc-1fb6cef960b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:22.587305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da72bf-e648-4e5f-83dc-1fb6cef960b9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:22.597888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 141/279] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:22.599176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df733-4893-4d99-9749-ec57115a7bde None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.599625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df733-4893-4d99-9749-ec57115a7bde None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.599911 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6df733-4893-4d99-9749-ec57115a7bde None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.601301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 142/280] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:22.601844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6df733-4893-4d99-9749-ec57115a7bde None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:22.610132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c55998-5580-4b1c-af46-0ef06817089c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:22.646541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a5f9-76c7-466d-b1fe-e567363c846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:22.647240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a5f9-76c7-466d-b1fe-e567363c846d None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.647527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a5f9-76c7-466d-b1fe-e567363c846d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.647803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a5f9-76c7-466d-b1fe-e567363c846d None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.648511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59a5f9-76c7-466d-b1fe-e567363c846d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:22.649975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59a5f9-76c7-466d-b1fe-e567363c846d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:22.702805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6df733-4893-4d99-9749-ec57115a7bde None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:22.735638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2efa7-5d3f-47ab-b918-bf4d0d94cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:22.736292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2efa7-5d3f-47ab-b918-bf4d0d94cc31 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.737121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2efa7-5d3f-47ab-b918-bf4d0d94cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.737683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2efa7-5d3f-47ab-b918-bf4d0d94cc31 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.738084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2efa7-5d3f-47ab-b918-bf4d0d94cc31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:22.738335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 139/281] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:22 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:22.738436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2efa7-5d3f-47ab-b918-bf4d0d94cc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:22.739783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2efa7-5d3f-47ab-b918-bf4d0d94cc31 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:22.749821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 143/282] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:22.751184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d651-7da5-4272-a56b-4e8919a0beed None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.751473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d651-7da5-4272-a56b-4e8919a0beed None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.751747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74d651-7da5-4272-a56b-4e8919a0beed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.755865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a5f9-76c7-466d-b1fe-e567363c846d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:22.764637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:22.772011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2b74d651-7da5-4272-a56b-4e8919a0beed None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:22.773395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2b74d651-7da5-4272-a56b-4e8919a0beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:22.778053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:22.870870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 144/283] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:22.870870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d651-7da5-4272-a56b-4e8919a0beed None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:22.883705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a5f9-76c7-466d-b1fe-e567363c846d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:22.930627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adf889-acb7-461f-a4f0-412d7a9c648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:22.933606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adf889-acb7-461f-a4f0-412d7a9c648a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:22.933606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adf889-acb7-461f-a4f0-412d7a9c648a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:22.933606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adf889-acb7-461f-a4f0-412d7a9c648a None admin] PATH_INFO: `/v3/users/adff37efef9a4f65812e53d18d449f94` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:22.933606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adf889-acb7-461f-a4f0-412d7a9c648a None admin] RBAC: Authorizing `identity:get_user(user_id=adff37efef9a4f65812e53d18d449f94)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:22.934694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adf889-acb7-461f-a4f0-412d7a9c648a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:22.936388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 140/284] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:22 2022] GET /identity/v3/users/adff37efef9a4f65812e53d18d449f94 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:22.937154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adf889-acb7-461f-a4f0-412d7a9c648a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:22.995594 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74d651-7da5-4272-a56b-4e8919a0beed None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:23.034579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:23.045268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a103c-f4f0-4c72-8558-8089940535d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:23.046439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a103c-f4f0-4c72-8558-8089940535d4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:23.046724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a103c-f4f0-4c72-8558-8089940535d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:23.052014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a103c-f4f0-4c72-8558-8089940535d4 None admin] PATH_INFO: `/v3/users/444307c7b80c4c08a9ada5a2dd1d3f6f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:23.052776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:23.054303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adf889-acb7-461f-a4f0-412d7a9c648a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:23.066119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a103c-f4f0-4c72-8558-8089940535d4 None admin] RBAC: Authorizing `identity:get_user(user_id=444307c7b80c4c08a9ada5a2dd1d3f6f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:23.067837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a103c-f4f0-4c72-8558-8089940535d4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:23.071808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 145/285] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:22 2022] GET /identity/v3/users/444307c7b80c4c08a9ada5a2dd1d3f6f => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:23.071808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a103c-f4f0-4c72-8558-8089940535d4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:23.100420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d178a9-7063-48d8-9a35-ebbfeff94ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:23.101512 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d178a9-7063-48d8-9a35-ebbfeff94ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:23.101931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d178a9-7063-48d8-9a35-ebbfeff94ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:23.102229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d178a9-7063-48d8-9a35-ebbfeff94ae0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:23.119747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d178a9-7063-48d8-9a35-ebbfeff94ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c9d178a9-7063-48d8-9a35-ebbfeff94ae0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:23.128355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:23.129240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:23.130019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 141/286] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:23.131182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d178a9-7063-48d8-9a35-ebbfeff94ae0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:23.186905 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a103c-f4f0-4c72-8558-8089940535d4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:23.224175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea4b06-f1d6-4411-a679-774c765cd1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:23.225437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea4b06-f1d6-4411-a679-774c765cd1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:23.225968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea4b06-f1d6-4411-a679-774c765cd1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:23.226458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea4b06-f1d6-4411-a679-774c765cd1a9 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:23.227899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea4b06-f1d6-4411-a679-774c765cd1a9 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:23.229538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea4b06-f1d6-4411-a679-774c765cd1a9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:23.231862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 146/287] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:23 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:23.233073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea4b06-f1d6-4411-a679-774c765cd1a9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:23.261707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d178a9-7063-48d8-9a35-ebbfeff94ae0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:23.305595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae766346-6f89-47a4-ad1b-425c6346114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:23.306313 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae766346-6f89-47a4-ad1b-425c6346114a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:23.306608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae766346-6f89-47a4-ad1b-425c6346114a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:23.306923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae766346-6f89-47a4-ad1b-425c6346114a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:23.307868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae766346-6f89-47a4-ad1b-425c6346114a None admin] RBAC: Adding query filter params (role.id=67691f718ae34424ae84912841aee8df, user.id=444307c7b80c4c08a9ada5a2dd1d3f6f, scope.system=all) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:23.308216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae766346-6f89-47a4-ad1b-425c6346114a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:23.309789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae766346-6f89-47a4-ad1b-425c6346114a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:23.314479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:23.317073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 142/288] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 09:27:23 2022] GET /identity/v3/role_assignments?user.id=444307c7b80c4c08a9ada5a2dd1d3f6f&scope.system=all&role.id=67691f718ae34424ae84912841aee8df => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:23.317867 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae766346-6f89-47a4-ad1b-425c6346114a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:23.343772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:23.361263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea4b06-f1d6-4411-a679-774c765cd1a9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:23.400627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2ddf9-da47-43f3-b338-151d903e4ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:23.401475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2ddf9-da47-43f3-b338-151d903e4ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:23.401886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2ddf9-da47-43f3-b338-151d903e4ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:23.402266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2ddf9-da47-43f3-b338-151d903e4ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:23.403222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2ddf9-da47-43f3-b338-151d903e4ce0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:23.403607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2ddf9-da47-43f3-b338-151d903e4ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:23.405122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2ddf9-da47-43f3-b338-151d903e4ce0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:23.415726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 147/289] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:23.424190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2ddf9-da47-43f3-b338-151d903e4ce0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:23.571329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae766346-6f89-47a4-ad1b-425c6346114a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:23.609332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2ddf9-da47-43f3-b338-151d903e4ce0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:23.644155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdda91-f879-4dfb-83cc-30cc8de45c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:23.645066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdda91-f879-4dfb-83cc-30cc8de45c12 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:23.645355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdda91-f879-4dfb-83cc-30cc8de45c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:23.645634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdda91-f879-4dfb-83cc-30cc8de45c12 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc/users/adff37efef9a4f65812e53d18d449f94/roles/b6f66ee2ec664d738bf2a67e41decbc4` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:23.651681 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdda91-f879-4dfb-83cc-30cc8de45c12 None admin] RBAC: Authorizing `identity:create_grant(project_id=a82eabb094424b2fbf694476a02fb1cc, user_id=adff37efef9a4f65812e53d18d449f94, role_id=b6f66ee2ec664d738bf2a67e41decbc4)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:23.653189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdda91-f879-4dfb-83cc-30cc8de45c12 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:23.661519 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:23.675707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36935c-63c4-4cf0-aeb5-86e95567628b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:23.676805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36935c-63c4-4cf0-aeb5-86e95567628b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:23.677097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36935c-63c4-4cf0-aeb5-86e95567628b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:23.677380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36935c-63c4-4cf0-aeb5-86e95567628b None admin] PATH_INFO: `/v3/users/b10470dc00c842f19df9de8d3f1ef34e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:23.679914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36935c-63c4-4cf0-aeb5-86e95567628b None admin] RBAC: Authorizing `identity:get_user(user_id=b10470dc00c842f19df9de8d3f1ef34e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:23.680368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36935c-63c4-4cf0-aeb5-86e95567628b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:23.682421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 148/290] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:23 2022] GET /identity/v3/users/b10470dc00c842f19df9de8d3f1ef34e => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:23.687979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36935c-63c4-4cf0-aeb5-86e95567628b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:23.734002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 143/291] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:27:23 2022] PUT /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc/users/adff37efef9a4f65812e53d18d449f94/roles/b6f66ee2ec664d738bf2a67e41decbc4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:23.818152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36935c-63c4-4cf0-aeb5-86e95567628b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:23.879213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60974b8-0d60-4902-bbb1-919fb6300b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:23.879213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60974b8-0d60-4902-bbb1-919fb6300b83 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:23.879213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60974b8-0d60-4902-bbb1-919fb6300b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:23.879213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60974b8-0d60-4902-bbb1-919fb6300b83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:23.928615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:23.939482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60974b8-0d60-4902-bbb1-919fb6300b83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:23.943359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60974b8-0d60-4902-bbb1-919fb6300b83 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:24.049966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 149/292] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 09:27:24.055590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdda91-f879-4dfb-83cc-30cc8de45c12 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:24.131937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:24.173273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdda91-f879-4dfb-83cc-30cc8de45c12 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:24.212624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f358737-11b5-453b-b6b0-b0f9e3f33836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:24.213507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f358737-11b5-453b-b6b0-b0f9e3f33836 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:24.213795 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f358737-11b5-453b-b6b0-b0f9e3f33836 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:24.214077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f358737-11b5-453b-b6b0-b0f9e3f33836 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:24.215327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f358737-11b5-453b-b6b0-b0f9e3f33836 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:24.216878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f358737-11b5-453b-b6b0-b0f9e3f33836 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:24.218990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 144/293] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:24 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:24.224900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60974b8-0d60-4902-bbb1-919fb6300b83 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:24.338637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:24.347684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60974b8-0d60-4902-bbb1-919fb6300b83 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:24.383921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850aa200-8616-408f-9236-556d5ea876ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:24.384506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aa200-8616-408f-9236-556d5ea876ce None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:24.384799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aa200-8616-408f-9236-556d5ea876ce None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:24.385085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850aa200-8616-408f-9236-556d5ea876ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:24.386001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aa200-8616-408f-9236-556d5ea876ce None admin] RBAC: Adding query filter params (role.id=67691f718ae34424ae84912841aee8df, scope.project.id=a82eabb094424b2fbf694476a02fb1cc, user.id=b10470dc00c842f19df9de8d3f1ef34e) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:24.386317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aa200-8616-408f-9236-556d5ea876ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:24.387851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850aa200-8616-408f-9236-556d5ea876ce None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:24.394527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 150/294] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:24 2022] GET /identity/v3/role_assignments?user.id=b10470dc00c842f19df9de8d3f1ef34e&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=67691f718ae34424ae84912841aee8df => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:25.154789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596c959-a3e0-400d-82f2-2414e48539d0 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.155318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596c959-a3e0-400d-82f2-2414e48539d0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.155391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596c959-a3e0-400d-82f2-2414e48539d0 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.156977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 145/295] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:25.162436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d1dd-dce2-4317-b5b4-82e29f0a7da5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.162883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d1dd-dce2-4317-b5b4-82e29f0a7da5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.163053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204d1dd-dce2-4317-b5b4-82e29f0a7da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.181689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6204d1dd-dce2-4317-b5b4-82e29f0a7da5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:25.182926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6204d1dd-dce2-4317-b5b4-82e29f0a7da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:25.187055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e89f29-131e-431e-b561-e78e5cac7e88 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.187346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e89f29-131e-431e-b561-e78e5cac7e88 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.187623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e89f29-131e-431e-b561-e78e5cac7e88 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.188995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 146/296] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:25.195241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d3bbf-1241-47d4-983e-459b6926567e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.195535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d3bbf-1241-47d4-983e-459b6926567e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.195811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d3bbf-1241-47d4-983e-459b6926567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.214257 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0c3d3bbf-1241-47d4-983e-459b6926567e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:25.215617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0c3d3bbf-1241-47d4-983e-459b6926567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:25.258834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 151/297] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:25.282581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d1dd-dce2-4317-b5b4-82e29f0a7da5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:25.309714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 147/298] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:25.333937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d3bbf-1241-47d4-983e-459b6926567e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:25.385512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:25.402238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204d1dd-dce2-4317-b5b4-82e29f0a7da5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:25.431419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:25.441164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616190a9-1d0d-493d-a5fd-a864153d27cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:25.447981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616190a9-1d0d-493d-a5fd-a864153d27cd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.447981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616190a9-1d0d-493d-a5fd-a864153d27cd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.447981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616190a9-1d0d-493d-a5fd-a864153d27cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.454572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616190a9-1d0d-493d-a5fd-a864153d27cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-616190a9-1d0d-493d-a5fd-a864153d27cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:25.464354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:25.465411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:25.466196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:25.466821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d3bbf-1241-47d4-983e-459b6926567e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:25.474507 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 152/299] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:27:25.475643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616190a9-1d0d-493d-a5fd-a864153d27cd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:25.509296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3851-1646-4809-99ed-45fe59f1a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:25.510359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3851-1646-4809-99ed-45fe59f1a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.510640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3851-1646-4809-99ed-45fe59f1a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.510941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3851-1646-4809-99ed-45fe59f1a3d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.512339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3851-1646-4809-99ed-45fe59f1a3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:25.514492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3851-1646-4809-99ed-45fe59f1a3d8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:25.516399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 148/300] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:25.522369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3851-1646-4809-99ed-45fe59f1a3d8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:25.597154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616190a9-1d0d-493d-a5fd-a864153d27cd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:25.628358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3851-1646-4809-99ed-45fe59f1a3d8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:25.636197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77c2c-7ca7-46a1-81d5-410b6ed9ae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:25.637167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77c2c-7ca7-46a1-81d5-410b6ed9ae47 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.637635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77c2c-7ca7-46a1-81d5-410b6ed9ae47 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.638197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc77c2c-7ca7-46a1-81d5-410b6ed9ae47 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.639200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc77c2c-7ca7-46a1-81d5-410b6ed9ae47 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:25.639921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc77c2c-7ca7-46a1-81d5-410b6ed9ae47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:25.641518 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc77c2c-7ca7-46a1-81d5-410b6ed9ae47 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:25.656625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 153/301] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:25.657877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77c2c-7ca7-46a1-81d5-410b6ed9ae47 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:25.666937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd4c04-0bb4-4767-9825-23d75340becc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:25.667694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4c04-0bb4-4767-9825-23d75340becc None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.668043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4c04-0bb4-4767-9825-23d75340becc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.668257 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4c04-0bb4-4767-9825-23d75340becc None admin] PATH_INFO: `/v3/groups` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.669066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd4c04-0bb4-4767-9825-23d75340becc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:25.670477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd4c04-0bb4-4767-9825-23d75340becc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:25.673349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:25.673838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:25.739373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 149/302] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Jun 24 09:27:25 2022] POST /identity/v3/groups => generated 229 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:25.748475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115485c-66a3-43b4-a49e-ebc77a7dd9f4 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.748778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115485c-66a3-43b4-a49e-ebc77a7dd9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.749047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115485c-66a3-43b4-a49e-ebc77a7dd9f4 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.750426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 150/303] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:25.756242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ed780-0c92-4312-b7ab-2ef6c04088f1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.763361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ed780-0c92-4312-b7ab-2ef6c04088f1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.763647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ed780-0c92-4312-b7ab-2ef6c04088f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.776656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc77c2c-7ca7-46a1-81d5-410b6ed9ae47 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:25.795981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-993ed780-0c92-4312-b7ab-2ef6c04088f1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:25.797703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-993ed780-0c92-4312-b7ab-2ef6c04088f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:25.826626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b80b0-71c9-4225-a1a0-fd47ee2c504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:25.827802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b80b0-71c9-4225-a1a0-fd47ee2c504a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:25.828995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b80b0-71c9-4225-a1a0-fd47ee2c504a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:25.829495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b80b0-71c9-4225-a1a0-fd47ee2c504a None admin] PATH_INFO: `/v3/users/1e343e6b27e943ea81467c841f01a80d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:25.851438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b80b0-71c9-4225-a1a0-fd47ee2c504a None admin] RBAC: Authorizing `identity:get_user(user_id=1e343e6b27e943ea81467c841f01a80d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:25.853296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b80b0-71c9-4225-a1a0-fd47ee2c504a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:25.856114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 154/304] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:25 2022] GET /identity/v3/users/1e343e6b27e943ea81467c841f01a80d => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:25.862153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b80b0-71c9-4225-a1a0-fd47ee2c504a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:25.891791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 151/305] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:25.915546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ed780-0c92-4312-b7ab-2ef6c04088f1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:25.942226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:25.985342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b80b0-71c9-4225-a1a0-fd47ee2c504a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:26.034929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40268a-c3dd-46a0-b5a6-39da36cde334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:26.035882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40268a-c3dd-46a0-b5a6-39da36cde334 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.036180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40268a-c3dd-46a0-b5a6-39da36cde334 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.036463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40268a-c3dd-46a0-b5a6-39da36cde334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.038040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40268a-c3dd-46a0-b5a6-39da36cde334 None admin] RBAC: Adding query filter params (role.id=b6f66ee2ec664d738bf2a67e41decbc4, user.id=1e343e6b27e943ea81467c841f01a80d, scope.system=all) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:26.038626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40268a-c3dd-46a0-b5a6-39da36cde334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:26.040107 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40268a-c3dd-46a0-b5a6-39da36cde334 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:26.040322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ed780-0c92-4312-b7ab-2ef6c04088f1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:26.048132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 155/306] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 09:27:25 2022] GET /identity/v3/role_assignments?user.id=1e343e6b27e943ea81467c841f01a80d&scope.system=all&role.id=b6f66ee2ec664d738bf2a67e41decbc4 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:26.076578 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:26.089620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a9623-f2b0-46ba-8895-2509fbf85d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:26.090687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a9623-f2b0-46ba-8895-2509fbf85d2d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.090687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a9623-f2b0-46ba-8895-2509fbf85d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.091029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a9623-f2b0-46ba-8895-2509fbf85d2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.103554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a9623-f2b0-46ba-8895-2509fbf85d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-261a9623-f2b0-46ba-8895-2509fbf85d2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:26.113513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:26.114450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:26.115710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 152/307] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:26.121531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40268a-c3dd-46a0-b5a6-39da36cde334 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:26.234954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40268a-c3dd-46a0-b5a6-39da36cde334 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:26.265097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:26.271768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212a128-c908-422d-9769-8a5c2f6638d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:26.272438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212a128-c908-422d-9769-8a5c2f6638d5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.272721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212a128-c908-422d-9769-8a5c2f6638d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.272995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212a128-c908-422d-9769-8a5c2f6638d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.273856 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212a128-c908-422d-9769-8a5c2f6638d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:26.274164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212a128-c908-422d-9769-8a5c2f6638d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:26.275565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212a128-c908-422d-9769-8a5c2f6638d5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:26.284645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 156/308] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:26.290251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a9623-f2b0-46ba-8895-2509fbf85d2d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:26.318092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ef717-5f39-42e6-b6e0-895bcc6eb0c5 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.318762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ef717-5f39-42e6-b6e0-895bcc6eb0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.319081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ef717-5f39-42e6-b6e0-895bcc6eb0c5 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.321708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 157/309] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:26.326705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc36650-f0df-4609-96a6-dc93efdf5d66 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.327030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc36650-f0df-4609-96a6-dc93efdf5d66 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.327315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc36650-f0df-4609-96a6-dc93efdf5d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.344538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0dc36650-f0df-4609-96a6-dc93efdf5d66 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:26.345731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0dc36650-f0df-4609-96a6-dc93efdf5d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:26.415136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a9623-f2b0-46ba-8895-2509fbf85d2d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:26.427186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 158/310] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:26.442300 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc36650-f0df-4609-96a6-dc93efdf5d66 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:26.453184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb486364-695b-4a28-881e-4869fcb6f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:26.454489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb486364-695b-4a28-881e-4869fcb6f482 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.455079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb486364-695b-4a28-881e-4869fcb6f482 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.455434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb486364-695b-4a28-881e-4869fcb6f482 None admin] PATH_INFO: `/v3/users/444307c7b80c4c08a9ada5a2dd1d3f6f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.457053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb486364-695b-4a28-881e-4869fcb6f482 None admin] RBAC: Authorizing `identity:get_user(user_id=444307c7b80c4c08a9ada5a2dd1d3f6f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:26.459317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb486364-695b-4a28-881e-4869fcb6f482 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:26.461610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 153/311] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:26 2022] GET /identity/v3/users/444307c7b80c4c08a9ada5a2dd1d3f6f => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:26.467346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb486364-695b-4a28-881e-4869fcb6f482 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:26.539216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:26.558482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc36650-f0df-4609-96a6-dc93efdf5d66 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:26.583213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:26.599085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fb1ef-aa55-4113-9cac-7bd5860a9c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:26.600371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fb1ef-aa55-4113-9cac-7bd5860a9c7d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.600821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fb1ef-aa55-4113-9cac-7bd5860a9c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.601261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fb1ef-aa55-4113-9cac-7bd5860a9c7d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.612791 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fb1ef-aa55-4113-9cac-7bd5860a9c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:26.613211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb486364-695b-4a28-881e-4869fcb6f482 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-017fb1ef-aa55-4113-9cac-7bd5860a9c7d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:26.621352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:26.622245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:26.623052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:26.631320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 159/312] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:27:26.632439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fb1ef-aa55-4113-9cac-7bd5860a9c7d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:26.653423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244e00-c6c3-4581-97c4-8c7b90472bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:26.654293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244e00-c6c3-4581-97c4-8c7b90472bd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.654574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244e00-c6c3-4581-97c4-8c7b90472bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.654876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244e00-c6c3-4581-97c4-8c7b90472bd3 None admin] PATH_INFO: `/v3/system/users/444307c7b80c4c08a9ada5a2dd1d3f6f/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.656348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244e00-c6c3-4581-97c4-8c7b90472bd3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=444307c7b80c4c08a9ada5a2dd1d3f6f, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:26.658724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244e00-c6c3-4581-97c4-8c7b90472bd3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:26.740817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fb1ef-aa55-4113-9cac-7bd5860a9c7d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:26.762174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 154/313] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Jun 24 09:27:26 2022] PUT /identity/v3/system/users/444307c7b80c4c08a9ada5a2dd1d3f6f/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:26.778769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635f8ad-5ce0-4543-b18e-0d81569c627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:26.779536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635f8ad-5ce0-4543-b18e-0d81569c627c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.779822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635f8ad-5ce0-4543-b18e-0d81569c627c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.780188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635f8ad-5ce0-4543-b18e-0d81569c627c None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.780960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635f8ad-5ce0-4543-b18e-0d81569c627c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:26.781269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635f8ad-5ce0-4543-b18e-0d81569c627c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:26.782682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e635f8ad-5ce0-4543-b18e-0d81569c627c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:26.794191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 160/314] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:26.800691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244e00-c6c3-4581-97c4-8c7b90472bd3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:26.914451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244e00-c6c3-4581-97c4-8c7b90472bd3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:26.937604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:26.961055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae49c26-221b-4905-b2d6-0e2bbfe61aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:26.961947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae49c26-221b-4905-b2d6-0e2bbfe61aba None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:26.962233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae49c26-221b-4905-b2d6-0e2bbfe61aba None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:26.962614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae49c26-221b-4905-b2d6-0e2bbfe61aba None admin] PATH_INFO: `/v3/users/adff37efef9a4f65812e53d18d449f94` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:26.963916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae49c26-221b-4905-b2d6-0e2bbfe61aba None admin] RBAC: Authorizing `identity:get_user(user_id=adff37efef9a4f65812e53d18d449f94)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:26.965381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae49c26-221b-4905-b2d6-0e2bbfe61aba None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:26.967383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 155/315] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:26 2022] GET /identity/v3/users/adff37efef9a4f65812e53d18d449f94 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:26.973549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635f8ad-5ce0-4543-b18e-0d81569c627c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:27.029552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:27.087913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635f8ad-5ce0-4543-b18e-0d81569c627c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:27.124223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ad8f6-8851-446e-ba19-3a5323e39b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:27.125206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ad8f6-8851-446e-ba19-3a5323e39b92 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:27.125673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ad8f6-8851-446e-ba19-3a5323e39b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:27.126126 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ad8f6-8851-446e-ba19-3a5323e39b92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:27.200583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ad8f6-8851-446e-ba19-3a5323e39b92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:27.202320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ad8f6-8851-446e-ba19-3a5323e39b92 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:27.251824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:27.311500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 161/316] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:27.316968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae49c26-221b-4905-b2d6-0e2bbfe61aba None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:27.421044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae49c26-221b-4905-b2d6-0e2bbfe61aba None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:27.456024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aaaec2-6904-4fcf-a24e-d6fc5998ed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:27.457354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaaec2-6904-4fcf-a24e-d6fc5998ed36 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:27.457839 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaaec2-6904-4fcf-a24e-d6fc5998ed36 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:27.458309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aaaec2-6904-4fcf-a24e-d6fc5998ed36 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:27.459747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaaec2-6904-4fcf-a24e-d6fc5998ed36 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:27.461403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aaaec2-6904-4fcf-a24e-d6fc5998ed36 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:27.463672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 156/317] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:27 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:27.469622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ad8f6-8851-446e-ba19-3a5323e39b92 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:27.583876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ad8f6-8851-446e-ba19-3a5323e39b92 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:27.621236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2c48-962a-4925-973c-31c2c271a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:27.621903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2c48-962a-4925-973c-31c2c271a774 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:27.622191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2c48-962a-4925-973c-31c2c271a774 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:27.622471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2c48-962a-4925-973c-31c2c271a774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:27.623355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2c48-962a-4925-973c-31c2c271a774 None admin] RBAC: Adding query filter params (role.id=b6f66ee2ec664d738bf2a67e41decbc4, scope.project.id=a82eabb094424b2fbf694476a02fb1cc, user.id=adff37efef9a4f65812e53d18d449f94) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:27.623665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2c48-962a-4925-973c-31c2c271a774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:27.625090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2c48-962a-4925-973c-31c2c271a774 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:27.632141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 162/318] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:27 2022] GET /identity/v3/role_assignments?user.id=adff37efef9a4f65812e53d18d449f94&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=b6f66ee2ec664d738bf2a67e41decbc4 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:27.969203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b9c08-f82a-4d95-9668-0454baf412b9 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:27.969601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b9c08-f82a-4d95-9668-0454baf412b9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:27.969888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b9c08-f82a-4d95-9668-0454baf412b9 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:27.971652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 157/319] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:27.977034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612686f6-9230-49d6-b86a-913509635f64 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:27.977318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612686f6-9230-49d6-b86a-913509635f64 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:27.977602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612686f6-9230-49d6-b86a-913509635f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:27.996321 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-612686f6-9230-49d6-b86a-913509635f64 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:27.997504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-612686f6-9230-49d6-b86a-913509635f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:27.999856 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:28.067827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 163/320] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:28.090165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b9c08-f82a-4d95-9668-0454baf412b9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:28.126251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129739f9-ee2f-453f-9fe3-c5f8496473ac None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.126539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129739f9-ee2f-453f-9fe3-c5f8496473ac None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.126821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129739f9-ee2f-453f-9fe3-c5f8496473ac None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.129045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 164/321] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:28.133777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137abdff-2907-4370-8657-eb8540d99baa None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.134069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137abdff-2907-4370-8657-eb8540d99baa None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.134351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137abdff-2907-4370-8657-eb8540d99baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.151984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-137abdff-2907-4370-8657-eb8540d99baa None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:28.153149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-137abdff-2907-4370-8657-eb8540d99baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:28.153263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:28.203413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b9c08-f82a-4d95-9668-0454baf412b9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:28.223763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 165/322] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:28.238964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16a5e7-027e-4238-9d97-c6b0b7fd101c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:28.239759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16a5e7-027e-4238-9d97-c6b0b7fd101c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.240045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16a5e7-027e-4238-9d97-c6b0b7fd101c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.240319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16a5e7-027e-4238-9d97-c6b0b7fd101c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.241475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16a5e7-027e-4238-9d97-c6b0b7fd101c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:28.242961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16a5e7-027e-4238-9d97-c6b0b7fd101c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:28.244698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 158/323] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:28.247061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137abdff-2907-4370-8657-eb8540d99baa None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:28.249701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16a5e7-027e-4238-9d97-c6b0b7fd101c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:28.317181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:28.351022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137abdff-2907-4370-8657-eb8540d99baa None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:28.358666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16a5e7-027e-4238-9d97-c6b0b7fd101c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:28.380868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:28.386214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db7382-af62-4b40-ae8d-5d5a4f237f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:28.387049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db7382-af62-4b40-ae8d-5d5a4f237f96 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.387330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db7382-af62-4b40-ae8d-5d5a4f237f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.387608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db7382-af62-4b40-ae8d-5d5a4f237f96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.396215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af00e3-341b-47ec-aa84-62dff8a5e828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:28.396879 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af00e3-341b-47ec-aa84-62dff8a5e828 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.397163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af00e3-341b-47ec-aa84-62dff8a5e828 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.397440 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af00e3-341b-47ec-aa84-62dff8a5e828 None admin] PATH_INFO: `/v3/groups` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.398129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af00e3-341b-47ec-aa84-62dff8a5e828 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:28.398728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db7382-af62-4b40-ae8d-5d5a4f237f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:28.399613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af00e3-341b-47ec-aa84-62dff8a5e828 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-51db7382-af62-4b40-ae8d-5d5a4f237f96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:28.406986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:28.408094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:28.408968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 166/324] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:28.414395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db7382-af62-4b40-ae8d-5d5a4f237f96 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:28.504941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 159/325] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Jun 24 09:27:28 2022] POST /identity/v3/groups => generated 226 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:27:28.520576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db7382-af62-4b40-ae8d-5d5a4f237f96 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:28.550466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:28.559224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1961a-00c6-4431-96ff-7481c5a064ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:28.559925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1961a-00c6-4431-96ff-7481c5a064ee None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.560215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1961a-00c6-4431-96ff-7481c5a064ee None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.560621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1961a-00c6-4431-96ff-7481c5a064ee None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.561274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1961a-00c6-4431-96ff-7481c5a064ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:28.561588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1961a-00c6-4431-96ff-7481c5a064ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:28.563076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1961a-00c6-4431-96ff-7481c5a064ee None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:28.575756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 167/326] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:28.579078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af00e3-341b-47ec-aa84-62dff8a5e828 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:28.693660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af00e3-341b-47ec-aa84-62dff8a5e828 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:28.730608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f171c52-9ec4-4622-9b35-290a4615e2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:28.731558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f171c52-9ec4-4622-9b35-290a4615e2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.731820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f171c52-9ec4-4622-9b35-290a4615e2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.732101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f171c52-9ec4-4622-9b35-290a4615e2a4 None admin] PATH_INFO: `/v3/users/1e343e6b27e943ea81467c841f01a80d` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.733603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f171c52-9ec4-4622-9b35-290a4615e2a4 None admin] RBAC: Authorizing `identity:get_user(user_id=1e343e6b27e943ea81467c841f01a80d)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:28.735091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f171c52-9ec4-4622-9b35-290a4615e2a4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:28.737990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 160/327] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:28 2022] GET /identity/v3/users/1e343e6b27e943ea81467c841f01a80d => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:28.743795 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1961a-00c6-4431-96ff-7481c5a064ee None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:28.852917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1961a-00c6-4431-96ff-7481c5a064ee None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:28.890088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0fbf1-69b3-42f7-8321-a4ebd6466ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:28.890991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0fbf1-69b3-42f7-8321-a4ebd6466ce8 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.891283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0fbf1-69b3-42f7-8321-a4ebd6466ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.891565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0fbf1-69b3-42f7-8321-a4ebd6466ce8 None admin] PATH_INFO: `/v3/system/users/1e343e6b27e943ea81467c841f01a80d/roles/b6f66ee2ec664d738bf2a67e41decbc4` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.893183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0fbf1-69b3-42f7-8321-a4ebd6466ce8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1e343e6b27e943ea81467c841f01a80d, role_id=b6f66ee2ec664d738bf2a67e41decbc4)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:28.894565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0fbf1-69b3-42f7-8321-a4ebd6466ce8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:28.972701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d7885-01cf-49b7-b2fc-73609509b64d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.973009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d7885-01cf-49b7-b2fc-73609509b64d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.973266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d7885-01cf-49b7-b2fc-73609509b64d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.975153 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 161/328] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:28.979100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 168/329] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Jun 24 09:27:28 2022] PUT /identity/v3/system/users/1e343e6b27e943ea81467c841f01a80d/roles/b6f66ee2ec664d738bf2a67e41decbc4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:28.980103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2d7e1-d48b-46e6-8297-9f90c38284a2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:28.980396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2d7e1-d48b-46e6-8297-9f90c38284a2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:28.980674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc2d7e1-d48b-46e6-8297-9f90c38284a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:28.999708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ecc2d7e1-d48b-46e6-8297-9f90c38284a2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:29.001305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ecc2d7e1-d48b-46e6-8297-9f90c38284a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:29.056245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:29.086250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 162/330] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:29.117419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0fbf1-69b3-42f7-8321-a4ebd6466ce8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:29.180349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:29.232072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0fbf1-69b3-42f7-8321-a4ebd6466ce8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:29.271041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9417c40-3b4c-4bbb-93f6-6f40b25318d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:29.272303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9417c40-3b4c-4bbb-93f6-6f40b25318d0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:29.272789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9417c40-3b4c-4bbb-93f6-6f40b25318d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:29.273254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9417c40-3b4c-4bbb-93f6-6f40b25318d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:29.287252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9417c40-3b4c-4bbb-93f6-6f40b25318d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e9417c40-3b4c-4bbb-93f6-6f40b25318d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:29.295724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:29.296610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:29.297382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:29.300152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 169/331] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:29.305746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2d7e1-d48b-46e6-8297-9f90c38284a2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:29.449751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc2d7e1-d48b-46e6-8297-9f90c38284a2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:29.499702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50753469-fdc8-45c0-83e6-85b06fef644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:29.500395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50753469-fdc8-45c0-83e6-85b06fef644f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:29.500682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50753469-fdc8-45c0-83e6-85b06fef644f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:29.500960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50753469-fdc8-45c0-83e6-85b06fef644f None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:29.501722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50753469-fdc8-45c0-83e6-85b06fef644f None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:29.502034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50753469-fdc8-45c0-83e6-85b06fef644f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:29.503551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50753469-fdc8-45c0-83e6-85b06fef644f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:29.512575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 163/332] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:29.518457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9417c40-3b4c-4bbb-93f6-6f40b25318d0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:29.657746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9417c40-3b4c-4bbb-93f6-6f40b25318d0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:29.672055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:29.695452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a612d5-f306-4e9f-8f6e-3235c523ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:29.696355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a612d5-f306-4e9f-8f6e-3235c523ee74 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:29.696644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a612d5-f306-4e9f-8f6e-3235c523ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:29.696927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a612d5-f306-4e9f-8f6e-3235c523ee74 None admin] PATH_INFO: `/v3/users/444307c7b80c4c08a9ada5a2dd1d3f6f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:29.699860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a612d5-f306-4e9f-8f6e-3235c523ee74 None admin] RBAC: Authorizing `identity:get_user(user_id=444307c7b80c4c08a9ada5a2dd1d3f6f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:29.701285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a612d5-f306-4e9f-8f6e-3235c523ee74 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:29.703190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 170/333] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:29 2022] GET /identity/v3/users/444307c7b80c4c08a9ada5a2dd1d3f6f => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:29.709401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50753469-fdc8-45c0-83e6-85b06fef644f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:29.798871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:29.864698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50753469-fdc8-45c0-83e6-85b06fef644f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:29.903360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4b0cc-a188-40f9-bc80-1f67cca2e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:29.904345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4b0cc-a188-40f9-bc80-1f67cca2e542 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:29.904812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4b0cc-a188-40f9-bc80-1f67cca2e542 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:29.905269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4b0cc-a188-40f9-bc80-1f67cca2e542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:29.906368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4b0cc-a188-40f9-bc80-1f67cca2e542 None admin] RBAC: Adding query filter params (role.id=67691f718ae34424ae84912841aee8df, user.id=444307c7b80c4c08a9ada5a2dd1d3f6f, scope.system=all) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:29.906881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4b0cc-a188-40f9-bc80-1f67cca2e542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:29.908580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4b0cc-a188-40f9-bc80-1f67cca2e542 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:29.923927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 164/334] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 09:27:29 2022] GET /identity/v3/role_assignments?user.id=444307c7b80c4c08a9ada5a2dd1d3f6f&scope.system=all&role.id=67691f718ae34424ae84912841aee8df => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:30.973163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840c65-79c8-47a1-8f2b-afc19d2e9017 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:30.973662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840c65-79c8-47a1-8f2b-afc19d2e9017 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:30.973662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840c65-79c8-47a1-8f2b-afc19d2e9017 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:30.975052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 171/335] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:30.980526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579dec-e64c-4187-adc6-deb0ff095380 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:30.981367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579dec-e64c-4187-adc6-deb0ff095380 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:30.981871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e579dec-e64c-4187-adc6-deb0ff095380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:31.007844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2e579dec-e64c-4187-adc6-deb0ff095380 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:31.009380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2e579dec-e64c-4187-adc6-deb0ff095380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:31.095770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 165/336] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:31.139226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840c65-79c8-47a1-8f2b-afc19d2e9017 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:31.276639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840c65-79c8-47a1-8f2b-afc19d2e9017 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:31.322406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea317f5f-7aea-47d2-921b-a416a635c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:31.323238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea317f5f-7aea-47d2-921b-a416a635c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:31.323523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea317f5f-7aea-47d2-921b-a416a635c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:31.323799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea317f5f-7aea-47d2-921b-a416a635c3a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:31.340634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea317f5f-7aea-47d2-921b-a416a635c3a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ea317f5f-7aea-47d2-921b-a416a635c3a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:31.349079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:31.349976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:31.350775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 172/337] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:31.356252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579dec-e64c-4187-adc6-deb0ff095380 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:31.396912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:31.498178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e579dec-e64c-4187-adc6-deb0ff095380 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:31.542088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33726b4a-a148-419f-806f-58e8cee2525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:31.542783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726b4a-a148-419f-806f-58e8cee2525d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:31.543096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726b4a-a148-419f-806f-58e8cee2525d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:31.543378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726b4a-a148-419f-806f-58e8cee2525d None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:31.544146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33726b4a-a148-419f-806f-58e8cee2525d None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:31.544454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33726b4a-a148-419f-806f-58e8cee2525d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:31.545859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33726b4a-a148-419f-806f-58e8cee2525d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:31.555574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 166/338] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:31.560904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea317f5f-7aea-47d2-921b-a416a635c3a3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:31.630694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:31.709746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea317f5f-7aea-47d2-921b-a416a635c3a3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:31.757747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8483d07-585f-429b-8c64-9c43bfe080d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:31.758750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8483d07-585f-429b-8c64-9c43bfe080d6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:31.759275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8483d07-585f-429b-8c64-9c43bfe080d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:31.759741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8483d07-585f-429b-8c64-9c43bfe080d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:31.792877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36bde-6138-430d-ad8a-694ab2827bbd None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:31.793485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36bde-6138-430d-ad8a-694ab2827bbd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:31.793983 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36bde-6138-430d-ad8a-694ab2827bbd None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:31.800122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 167/339] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:31.808268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ba5d6-69f7-4f60-aa25-1f677126e4c4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:31.808829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ba5d6-69f7-4f60-aa25-1f677126e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:31.809307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ba5d6-69f7-4f60-aa25-1f677126e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:31.840695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8483d07-585f-429b-8c64-9c43bfe080d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:31.842170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8483d07-585f-429b-8c64-9c43bfe080d6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:31.850320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-800ba5d6-69f7-4f60-aa25-1f677126e4c4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:31.851823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-800ba5d6-69f7-4f60-aa25-1f677126e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:31.891552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:31.958028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 173/340] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:31.965451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8483d07-585f-429b-8c64-9c43bfe080d6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:32.029155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 168/341] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:32.040552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278a1a-2bda-4d12-bd13-e2100e0dc48d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.041119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278a1a-2bda-4d12-bd13-e2100e0dc48d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.041594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278a1a-2bda-4d12-bd13-e2100e0dc48d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.043252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 169/342] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:32.064706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f050-0563-4e24-8527-4c8a3bb25466 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.065939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f050-0563-4e24-8527-4c8a3bb25466 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.066415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f050-0563-4e24-8527-4c8a3bb25466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.091643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8483d07-585f-429b-8c64-9c43bfe080d6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:32.106169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5a68f050-0563-4e24-8527-4c8a3bb25466 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:32.107972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5a68f050-0563-4e24-8527-4c8a3bb25466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:32.128290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47edf6c-fe34-40f1-9cd7-84c354cd1187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:32.129087 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47edf6c-fe34-40f1-9cd7-84c354cd1187 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.129374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47edf6c-fe34-40f1-9cd7-84c354cd1187 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.129709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47edf6c-fe34-40f1-9cd7-84c354cd1187 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.130999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47edf6c-fe34-40f1-9cd7-84c354cd1187 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:32.132430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47edf6c-fe34-40f1-9cd7-84c354cd1187 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:32.134266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 174/343] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:31 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:32.135151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:32.136260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47edf6c-fe34-40f1-9cd7-84c354cd1187 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:32.149898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:32.218037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 170/344] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:32.219467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb5ac5-7888-4433-8dea-baab56cb8b24 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.219761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb5ac5-7888-4433-8dea-baab56cb8b24 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.222351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb5ac5-7888-4433-8dea-baab56cb8b24 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.224072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 171/345] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:32.224830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb5ac5-7888-4433-8dea-baab56cb8b24 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:32.253268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47edf6c-fe34-40f1-9cd7-84c354cd1187 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:32.292820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839c82f-6697-4ccd-803e-00747c0b170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:32.294604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839c82f-6697-4ccd-803e-00747c0b170f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.295093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839c82f-6697-4ccd-803e-00747c0b170f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.295564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839c82f-6697-4ccd-803e-00747c0b170f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.309363 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839c82f-6697-4ccd-803e-00747c0b170f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-f839c82f-6697-4ccd-803e-00747c0b170f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:32.320686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:32.321571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:32.322343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:32.327576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 175/346] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:32.327576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d60a1-aa85-41d2-9ddb-ac3050a370de None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.327576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d60a1-aa85-41d2-9ddb-ac3050a370de None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.327576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d60a1-aa85-41d2-9ddb-ac3050a370de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.352618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ac0d60a1-aa85-41d2-9ddb-ac3050a370de None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:32.354591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ac0d60a1-aa85-41d2-9ddb-ac3050a370de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:32.362877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb5ac5-7888-4433-8dea-baab56cb8b24 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:32.400614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1610c35-5af0-4b61-8d18-26e43645dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:32.401682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1610c35-5af0-4b61-8d18-26e43645dc31 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.402021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1610c35-5af0-4b61-8d18-26e43645dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.402330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1610c35-5af0-4b61-8d18-26e43645dc31 None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.409501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1610c35-5af0-4b61-8d18-26e43645dc31 None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:32.411092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1610c35-5af0-4b61-8d18-26e43645dc31 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:32.412827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 172/347] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:32 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:32.413595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1610c35-5af0-4b61-8d18-26e43645dc31 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:32.424978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:32.430275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:32.431578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 176/348] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:32.432570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d60a1-aa85-41d2-9ddb-ac3050a370de None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:32.528784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1610c35-5af0-4b61-8d18-26e43645dc31 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:32.551900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d60a1-aa85-41d2-9ddb-ac3050a370de None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:32.568897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ca6a7-7a51-433e-9183-40daa4e9d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:32.569868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ca6a7-7a51-433e-9183-40daa4e9d1fe None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.570263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ca6a7-7a51-433e-9183-40daa4e9d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.570636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ca6a7-7a51-433e-9183-40daa4e9d1fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.582920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ca6a7-7a51-433e-9183-40daa4e9d1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-526ca6a7-7a51-433e-9183-40daa4e9d1fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:32.591156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:32.592357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:32.593339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:32.595065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 173/349] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:32.596104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ca6a7-7a51-433e-9183-40daa4e9d1fe None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:32.597698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ea27-994e-4a5e-889f-869b55b68cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:32.599132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ea27-994e-4a5e-889f-869b55b68cfc None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.599999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ea27-994e-4a5e-889f-869b55b68cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.600409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ea27-994e-4a5e-889f-869b55b68cfc None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.601420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356ea27-994e-4a5e-889f-869b55b68cfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:32.601866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356ea27-994e-4a5e-889f-869b55b68cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:32.604409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356ea27-994e-4a5e-889f-869b55b68cfc None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:32.617229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 177/350] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:32.618501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ea27-994e-4a5e-889f-869b55b68cfc None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:32.697135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:32.703300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:32.742365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ca6a7-7a51-433e-9183-40daa4e9d1fe None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:32.749043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ea27-994e-4a5e-889f-869b55b68cfc None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:32.780247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71b9a5-b198-4bfc-84a8-861881fe1310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:32.780928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71b9a5-b198-4bfc-84a8-861881fe1310 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.781207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71b9a5-b198-4bfc-84a8-861881fe1310 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.781488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71b9a5-b198-4bfc-84a8-861881fe1310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.782335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71b9a5-b198-4bfc-84a8-861881fe1310 None admin] RBAC: Adding query filter params (group.id=6237e9b574ac4be38346ccd717a6eb44, role.id=67691f718ae34424ae84912841aee8df, scope.project.id=8867c613b3214d72b178a25b63c2e0af) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:32.782653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71b9a5-b198-4bfc-84a8-861881fe1310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:32.784707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71b9a5-b198-4bfc-84a8-861881fe1310 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:32.789001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f501d-5b9f-48a2-a8e6-5576ac1d4d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:32.790067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f501d-5b9f-48a2-a8e6-5576ac1d4d8f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:32.790564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f501d-5b9f-48a2-a8e6-5576ac1d4d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:32.791080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f501d-5b9f-48a2-a8e6-5576ac1d4d8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:32.791647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 174/351] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:32 2022] GET /identity/v3/role_assignments?group.id=6237e9b574ac4be38346ccd717a6eb44&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=67691f718ae34424ae84912841aee8df => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:32.792481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71b9a5-b198-4bfc-84a8-861881fe1310 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:32.805223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f501d-5b9f-48a2-a8e6-5576ac1d4d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-256f501d-5b9f-48a2-a8e6-5576ac1d4d8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:32.814021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:32.815213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 09:27:32.816174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:32.819033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 178/352] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:32.820078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f501d-5b9f-48a2-a8e6-5576ac1d4d8f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:32.934373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71b9a5-b198-4bfc-84a8-861881fe1310 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:32.976292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f501d-5b9f-48a2-a8e6-5576ac1d4d8f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:33.007436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:33.008367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877926d-13a1-4193-bc30-89f87f767ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:33.008952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877926d-13a1-4193-bc30-89f87f767ffb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.009246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877926d-13a1-4193-bc30-89f87f767ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.009528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877926d-13a1-4193-bc30-89f87f767ffb None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.010481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877926d-13a1-4193-bc30-89f87f767ffb None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:33.010601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877926d-13a1-4193-bc30-89f87f767ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:33.012126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877926d-13a1-4193-bc30-89f87f767ffb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:33.019771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:33.025197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de0d0-26af-48e6-a920-ce7c1d5c4a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:33.026105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de0d0-26af-48e6-a920-ce7c1d5c4a07 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.026582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de0d0-26af-48e6-a920-ce7c1d5c4a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.027105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de0d0-26af-48e6-a920-ce7c1d5c4a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.027901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 175/353] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:33.028731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877926d-13a1-4193-bc30-89f87f767ffb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:33.110795 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9de0d0-26af-48e6-a920-ce7c1d5c4a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:33.113664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9de0d0-26af-48e6-a920-ce7c1d5c4a07 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:33.228909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877926d-13a1-4193-bc30-89f87f767ffb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:33.229819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 179/354] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:33.231152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de0d0-26af-48e6-a920-ce7c1d5c4a07 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:33.259487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:33.350318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de0d0-26af-48e6-a920-ce7c1d5c4a07 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:33.369480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf154f9-9737-45b1-9144-25b88574ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:33.370256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf154f9-9737-45b1-9144-25b88574ac54 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.370369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf154f9-9737-45b1-9144-25b88574ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.370641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf154f9-9737-45b1-9144-25b88574ac54 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.374122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf154f9-9737-45b1-9144-25b88574ac54 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:33.374449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf154f9-9737-45b1-9144-25b88574ac54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:33.375901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf154f9-9737-45b1-9144-25b88574ac54 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:33.405373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 176/355] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:33.406351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf154f9-9737-45b1-9144-25b88574ac54 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:33.407596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4798e27-8d49-4411-88db-d9a89ba55c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:33.408685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4798e27-8d49-4411-88db-d9a89ba55c91 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.409660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4798e27-8d49-4411-88db-d9a89ba55c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.410185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4798e27-8d49-4411-88db-d9a89ba55c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.564169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4798e27-8d49-4411-88db-d9a89ba55c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:33.566163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4798e27-8d49-4411-88db-d9a89ba55c91 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:33.594127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:33.615876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:33.651186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf154f9-9737-45b1-9144-25b88574ac54 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:33.697952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561cd36-04ca-497d-85ed-ac233bf5ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:33.698861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561cd36-04ca-497d-85ed-ac233bf5ad7e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.699156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561cd36-04ca-497d-85ed-ac233bf5ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.699530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561cd36-04ca-497d-85ed-ac233bf5ad7e None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.702069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561cd36-04ca-497d-85ed-ac233bf5ad7e None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:33.702604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561cd36-04ca-497d-85ed-ac233bf5ad7e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:33.704524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 177/356] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:33 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:33.705138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561cd36-04ca-497d-85ed-ac233bf5ad7e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:33.715291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 180/357] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:33.716912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4e211-4406-4504-af2c-24b8870e2c50 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.717444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4e211-4406-4504-af2c-24b8870e2c50 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.717955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4e211-4406-4504-af2c-24b8870e2c50 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.719801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 181/358] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:33.722284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d33a4-f8ba-48fd-99ad-7af98738d4ca None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.722781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d33a4-f8ba-48fd-99ad-7af98738d4ca None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.723272 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d33a4-f8ba-48fd-99ad-7af98738d4ca None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.724866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 182/359] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:33.725780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d33a4-f8ba-48fd-99ad-7af98738d4ca None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:33.838340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561cd36-04ca-497d-85ed-ac233bf5ad7e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:33.860677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d33a4-f8ba-48fd-99ad-7af98738d4ca None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:33.880221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:33.888173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b43a03-56ba-47fb-84d9-42a37db9b0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:33.889244 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b43a03-56ba-47fb-84d9-42a37db9b0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.889371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:33.889765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b43a03-56ba-47fb-84d9-42a37db9b0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.890299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b43a03-56ba-47fb-84d9-42a37db9b0e8 None admin] PATH_INFO: `/v3/users/1e343e6b27e943ea81467c841f01a80d` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.895088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b43a03-56ba-47fb-84d9-42a37db9b0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=1e343e6b27e943ea81467c841f01a80d)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:33.897519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b43a03-56ba-47fb-84d9-42a37db9b0e8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:33.900035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 178/360] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:27:33 2022] GET /identity/v3/users/1e343e6b27e943ea81467c841f01a80d => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:33.901310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b43a03-56ba-47fb-84d9-42a37db9b0e8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:33.905023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef2ea9-7365-4fcc-b497-998120f7dffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:33.906058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef2ea9-7365-4fcc-b497-998120f7dffe None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.906340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef2ea9-7365-4fcc-b497-998120f7dffe None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.906615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef2ea9-7365-4fcc-b497-998120f7dffe None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.907814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef2ea9-7365-4fcc-b497-998120f7dffe None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:33.910182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef2ea9-7365-4fcc-b497-998120f7dffe None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:33.911931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 183/361] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:33 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:33.913081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ff662-9e04-4efd-88a6-f947898de926 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:33.913366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ff662-9e04-4efd-88a6-f947898de926 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:33.913643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ff662-9e04-4efd-88a6-f947898de926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:33.931927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3d1ff662-9e04-4efd-88a6-f947898de926 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:33.933093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3d1ff662-9e04-4efd-88a6-f947898de926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:34.019347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 184/362] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:34.020810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaafd9-4211-4860-930b-7c84337c8203 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.021103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaafd9-4211-4860-930b-7c84337c8203 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.021443 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaafd9-4211-4860-930b-7c84337c8203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.027317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b43a03-56ba-47fb-84d9-42a37db9b0e8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:34.054974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-17aaafd9-4211-4860-930b-7c84337c8203 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:34.056457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-17aaafd9-4211-4860-930b-7c84337c8203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:34.070131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee981515-3be1-4bd8-9af2-093b96920731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:34.071041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee981515-3be1-4bd8-9af2-093b96920731 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.071328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee981515-3be1-4bd8-9af2-093b96920731 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.071609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee981515-3be1-4bd8-9af2-093b96920731 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.072839 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee981515-3be1-4bd8-9af2-093b96920731 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:34.074427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee981515-3be1-4bd8-9af2-093b96920731 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:34.076425 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 179/363] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:33 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:34.082985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee981515-3be1-4bd8-9af2-093b96920731 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.132703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 185/364] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:34.133681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaafd9-4211-4860-930b-7c84337c8203 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.166553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:34.198055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:34.214204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee981515-3be1-4bd8-9af2-093b96920731 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:34.265796 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaafd9-4211-4860-930b-7c84337c8203 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:34.269572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14deaa2-166f-4395-bc9e-1de849535e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:34.270047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14deaa2-166f-4395-bc9e-1de849535e72 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.270123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14deaa2-166f-4395-bc9e-1de849535e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.270366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14deaa2-166f-4395-bc9e-1de849535e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.271257 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14deaa2-166f-4395-bc9e-1de849535e72 None admin] RBAC: Adding query filter params (role.id=b6f66ee2ec664d738bf2a67e41decbc4, user.id=1e343e6b27e943ea81467c841f01a80d, scope.system=all) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:34.271575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14deaa2-166f-4395-bc9e-1de849535e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:34.273049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14deaa2-166f-4395-bc9e-1de849535e72 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:34.290990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 180/365] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/role_assignments?user.id=1e343e6b27e943ea81467c841f01a80d&scope.system=all&role.id=b6f66ee2ec664d738bf2a67e41decbc4 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:34.292781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14deaa2-166f-4395-bc9e-1de849535e72 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.313932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2251dfd-1c10-4a0e-bffc-368f911e5e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:34.315826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2251dfd-1c10-4a0e-bffc-368f911e5e52 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.316364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2251dfd-1c10-4a0e-bffc-368f911e5e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.316850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2251dfd-1c10-4a0e-bffc-368f911e5e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.317924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2251dfd-1c10-4a0e-bffc-368f911e5e52 None admin] RBAC: Adding query filter params (group.id=6237e9b574ac4be38346ccd717a6eb44, role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=8867c613b3214d72b178a25b63c2e0af) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:34.318463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2251dfd-1c10-4a0e-bffc-368f911e5e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:34.320201 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2251dfd-1c10-4a0e-bffc-368f911e5e52 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:34.326738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 186/366] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/role_assignments?group.id=6237e9b574ac4be38346ccd717a6eb44&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:34.328054 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2251dfd-1c10-4a0e-bffc-368f911e5e52 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.430992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14deaa2-166f-4395-bc9e-1de849535e72 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:34.469202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:34.479771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ba1bb-89d7-45ae-8cf5-c66ec5518985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:34.480614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ba1bb-89d7-45ae-8cf5-c66ec5518985 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.480911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ba1bb-89d7-45ae-8cf5-c66ec5518985 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.481196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ba1bb-89d7-45ae-8cf5-c66ec5518985 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.498724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ba1bb-89d7-45ae-8cf5-c66ec5518985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3d9ba1bb-89d7-45ae-8cf5-c66ec5518985 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:34.509011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:34.509985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:34.510764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 181/367] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:34.511466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ba1bb-89d7-45ae-8cf5-c66ec5518985 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.566951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2251dfd-1c10-4a0e-bffc-368f911e5e52 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:34.598124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:34.628669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f53593-05ab-45ff-8141-4f265f8725de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:34.629877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f53593-05ab-45ff-8141-4f265f8725de None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.630313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f53593-05ab-45ff-8141-4f265f8725de None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.630893 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f53593-05ab-45ff-8141-4f265f8725de None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.632361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f53593-05ab-45ff-8141-4f265f8725de None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:34.634082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f53593-05ab-45ff-8141-4f265f8725de None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:34.637408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 187/368] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:34.643668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f53593-05ab-45ff-8141-4f265f8725de None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.652319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ba1bb-89d7-45ae-8cf5-c66ec5518985 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:34.704838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a55b6f-40b1-44b8-9e58-3f8a220035d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:34.706278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a55b6f-40b1-44b8-9e58-3f8a220035d5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.706569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a55b6f-40b1-44b8-9e58-3f8a220035d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.706869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a55b6f-40b1-44b8-9e58-3f8a220035d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.723685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a55b6f-40b1-44b8-9e58-3f8a220035d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b5a55b6f-40b1-44b8-9e58-3f8a220035d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:34.733539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:34.734470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:34.735483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 182/369] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:34.736142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a55b6f-40b1-44b8-9e58-3f8a220035d5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.795746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:34.840168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f53593-05ab-45ff-8141-4f265f8725de None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:34.869979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a55b6f-40b1-44b8-9e58-3f8a220035d5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:34.878300 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6536a-68b3-41ca-884c-f5d43385670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:34.879168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6536a-68b3-41ca-884c-f5d43385670c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.879563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6536a-68b3-41ca-884c-f5d43385670c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.879949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6536a-68b3-41ca-884c-f5d43385670c None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.880718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6536a-68b3-41ca-884c-f5d43385670c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:34.881031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6536a-68b3-41ca-884c-f5d43385670c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:34.882415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6536a-68b3-41ca-884c-f5d43385670c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:34.892193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 188/370] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:34.895290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6536a-68b3-41ca-884c-f5d43385670c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.914417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8adcb-e4f8-41b4-88f1-30abf634b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:34.915118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8adcb-e4f8-41b4-88f1-30abf634b216 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.915652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8adcb-e4f8-41b4-88f1-30abf634b216 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.915934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8adcb-e4f8-41b4-88f1-30abf634b216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.917184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8adcb-e4f8-41b4-88f1-30abf634b216 None admin] RBAC: Adding query filter params (group.id=6237e9b574ac4be38346ccd717a6eb44, role.id=67691f718ae34424ae84912841aee8df, scope.project.id=a82eabb094424b2fbf694476a02fb1cc) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:34.917507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8adcb-e4f8-41b4-88f1-30abf634b216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:34.919010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe8adcb-e4f8-41b4-88f1-30abf634b216 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:34.926965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 183/371] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/role_assignments?group.id=6237e9b574ac4be38346ccd717a6eb44&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=67691f718ae34424ae84912841aee8df => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:34.928095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8adcb-e4f8-41b4-88f1-30abf634b216 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.950063 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:35.019121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6536a-68b3-41ca-884c-f5d43385670c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:35.069046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056e82c-001e-462c-95bb-851a291ea18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:35.070130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056e82c-001e-462c-95bb-851a291ea18a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.070623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056e82c-001e-462c-95bb-851a291ea18a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.071145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056e82c-001e-462c-95bb-851a291ea18a None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.072106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056e82c-001e-462c-95bb-851a291ea18a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:35.072635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056e82c-001e-462c-95bb-851a291ea18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:35.074219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056e82c-001e-462c-95bb-851a291ea18a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:35.074398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8adcb-e4f8-41b4-88f1-30abf634b216 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:35.086648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:35.088097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 189/372] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:35.094067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056e82c-001e-462c-95bb-851a291ea18a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:35.117093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bd90c-ebcf-4e93-8e5a-cb03b4f14d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:35.118110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bd90c-ebcf-4e93-8e5a-cb03b4f14d28 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.118742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bd90c-ebcf-4e93-8e5a-cb03b4f14d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.119293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bd90c-ebcf-4e93-8e5a-cb03b4f14d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.209414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bd90c-ebcf-4e93-8e5a-cb03b4f14d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:35.211487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bd90c-ebcf-4e93-8e5a-cb03b4f14d28 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:35.229821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056e82c-001e-462c-95bb-851a291ea18a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:35.238987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:35.276767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a278ce-6b68-459f-ad67-47d1c527ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:35.277907 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a278ce-6b68-459f-ad67-47d1c527ec1a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.278380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a278ce-6b68-459f-ad67-47d1c527ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.278838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a278ce-6b68-459f-ad67-47d1c527ec1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.346479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 184/373] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:35.348735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55017026-40c3-458e-b9a9-11a93e05c667 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.349211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55017026-40c3-458e-b9a9-11a93e05c667 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.349694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55017026-40c3-458e-b9a9-11a93e05c667 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.351423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 185/374] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:35.352366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55017026-40c3-458e-b9a9-11a93e05c667 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:35.362646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a278ce-6b68-459f-ad67-47d1c527ec1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:35.364684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a278ce-6b68-459f-ad67-47d1c527ec1a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:35.366323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:35.473579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55017026-40c3-458e-b9a9-11a93e05c667 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:35.494868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 190/375] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 09:27:35.494868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b14b-ccf9-4131-bb24-814efc154c87 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.494868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b14b-ccf9-4131-bb24-814efc154c87 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.494868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68b14b-ccf9-4131-bb24-814efc154c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.507376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:35.514894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3c68b14b-ccf9-4131-bb24-814efc154c87 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:35.520452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3c68b14b-ccf9-4131-bb24-814efc154c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:35.523532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73697e-5f6a-4209-adde-45461eb030f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:35.526551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73697e-5f6a-4209-adde-45461eb030f2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.527205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73697e-5f6a-4209-adde-45461eb030f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.527697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73697e-5f6a-4209-adde-45461eb030f2 None admin] PATH_INFO: `/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.529232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73697e-5f6a-4209-adde-45461eb030f2 None admin] RBAC: Authorizing `identity:get_project(project_id=ecfbe47b81cd4fe29763116c4e6fcb19)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:35.531021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73697e-5f6a-4209-adde-45461eb030f2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:35.533021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 186/376] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:35 2022] GET /identity/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:35.534672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73697e-5f6a-4209-adde-45461eb030f2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:35.604729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 191/377] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:35.605660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b14b-ccf9-4131-bb24-814efc154c87 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:35.638906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:35.677958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73697e-5f6a-4209-adde-45461eb030f2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:35.727669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb2477-fe8d-4c9c-8488-a5474b4fb3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:35.728547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb2477-fe8d-4c9c-8488-a5474b4fb3eb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.729364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb2477-fe8d-4c9c-8488-a5474b4fb3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.729647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb2477-fe8d-4c9c-8488-a5474b4fb3eb None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.730898 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb2477-fe8d-4c9c-8488-a5474b4fb3eb None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:35.733617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb2477-fe8d-4c9c-8488-a5474b4fb3eb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:35.736713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 187/378] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:35 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:35.737552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb2477-fe8d-4c9c-8488-a5474b4fb3eb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:35.745157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68b14b-ccf9-4131-bb24-814efc154c87 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:35.785014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9fa83-d3b2-4c82-bcb3-cdb598e61d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:35.785888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9fa83-d3b2-4c82-bcb3-cdb598e61d84 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.786173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9fa83-d3b2-4c82-bcb3-cdb598e61d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.786448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9fa83-d3b2-4c82-bcb3-cdb598e61d84 None admin] PATH_INFO: `/v3/groups/aec009f49af34d9d85aef6a4ea2e4079` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.790447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:35.793074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9fa83-d3b2-4c82-bcb3-cdb598e61d84 None admin] RBAC: Authorizing `identity:get_group(group_id=aec009f49af34d9d85aef6a4ea2e4079)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:35.794538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9fa83-d3b2-4c82-bcb3-cdb598e61d84 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:35.796445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 192/379] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:35 2022] GET /identity/v3/groups/aec009f49af34d9d85aef6a4ea2e4079 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:35.797221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9fa83-d3b2-4c82-bcb3-cdb598e61d84 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:35.853203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb2477-fe8d-4c9c-8488-a5474b4fb3eb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:35.892520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41112951-20a3-4131-b18e-60d86b2a2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:35.893389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41112951-20a3-4131-b18e-60d86b2a2210 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.893670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41112951-20a3-4131-b18e-60d86b2a2210 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.893945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41112951-20a3-4131-b18e-60d86b2a2210 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.908242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41112951-20a3-4131-b18e-60d86b2a2210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:35.914990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9fa83-d3b2-4c82-bcb3-cdb598e61d84 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-41112951-20a3-4131-b18e-60d86b2a2210 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:35.916638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:35.917572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 188/380] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:35.918894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41112951-20a3-4131-b18e-60d86b2a2210 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:35.922601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:35.957346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227bffe-a5b4-4d4a-bea7-d5a4dd62f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:35.958232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227bffe-a5b4-4d4a-bea7-d5a4dd62f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:35.958516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227bffe-a5b4-4d4a-bea7-d5a4dd62f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:35.958792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227bffe-a5b4-4d4a-bea7-d5a4dd62f0d4 None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:35.960045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227bffe-a5b4-4d4a-bea7-d5a4dd62f0d4 None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:35.961486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227bffe-a5b4-4d4a-bea7-d5a4dd62f0d4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:35.963579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 193/381] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:35 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:35.964493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227bffe-a5b4-4d4a-bea7-d5a4dd62f0d4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:36.032965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41112951-20a3-4131-b18e-60d86b2a2210 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:36.047516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:36.070401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba838105-5e9d-44a2-aae6-ca6edfab176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:36.071449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba838105-5e9d-44a2-aae6-ca6edfab176d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:36.071925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227bffe-a5b4-4d4a-bea7-d5a4dd62f0d4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:36.072145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba838105-5e9d-44a2-aae6-ca6edfab176d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:36.073484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba838105-5e9d-44a2-aae6-ca6edfab176d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:36.074547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba838105-5e9d-44a2-aae6-ca6edfab176d None admin] RBAC: Adding query filter params (group.id=aec009f49af34d9d85aef6a4ea2e4079, role.id=9312183c32b04118985c8316f33f3830, scope.project.id=ecfbe47b81cd4fe29763116c4e6fcb19) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:36.075103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba838105-5e9d-44a2-aae6-ca6edfab176d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:36.076781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba838105-5e9d-44a2-aae6-ca6edfab176d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:36.083498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 189/382] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:35 2022] GET /identity/v3/role_assignments?group.id=aec009f49af34d9d85aef6a4ea2e4079&scope.project.id=ecfbe47b81cd4fe29763116c4e6fcb19&role.id=9312183c32b04118985c8316f33f3830 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:36.084555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba838105-5e9d-44a2-aae6-ca6edfab176d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:36.131849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fdef9-b0f0-4aaa-82d2-2b9ffa24f927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:36.132541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fdef9-b0f0-4aaa-82d2-2b9ffa24f927 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:36.132827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fdef9-b0f0-4aaa-82d2-2b9ffa24f927 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:36.133108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fdef9-b0f0-4aaa-82d2-2b9ffa24f927 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:36.133975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fdef9-b0f0-4aaa-82d2-2b9ffa24f927 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:36.134290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fdef9-b0f0-4aaa-82d2-2b9ffa24f927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:36.135729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fdef9-b0f0-4aaa-82d2-2b9ffa24f927 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:36.155593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 194/383] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:36.162149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fdef9-b0f0-4aaa-82d2-2b9ffa24f927 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:36.163025 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:36.202931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba838105-5e9d-44a2-aae6-ca6edfab176d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:36.236993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d544434-e9c6-420c-b0b4-9581a99cfbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:36.237927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d544434-e9c6-420c-b0b4-9581a99cfbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:36.238311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d544434-e9c6-420c-b0b4-9581a99cfbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:36.238691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d544434-e9c6-420c-b0b4-9581a99cfbc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:36.242871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d544434-e9c6-420c-b0b4-9581a99cfbc6 None admin] RBAC: Adding query filter params (group.id=6237e9b574ac4be38346ccd717a6eb44, role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=a82eabb094424b2fbf694476a02fb1cc) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:36.242871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d544434-e9c6-420c-b0b4-9581a99cfbc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:36.242871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d544434-e9c6-420c-b0b4-9581a99cfbc6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:36.248377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 190/384] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:36 2022] GET /identity/v3/role_assignments?group.id=6237e9b574ac4be38346ccd717a6eb44&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:36.328996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fdef9-b0f0-4aaa-82d2-2b9ffa24f927 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:36.369478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:36.375829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28d710-da12-4f32-8b06-f267d34457e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:36.376733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28d710-da12-4f32-8b06-f267d34457e8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:36.377020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28d710-da12-4f32-8b06-f267d34457e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:36.377426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28d710-da12-4f32-8b06-f267d34457e8 None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:36.379252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28d710-da12-4f32-8b06-f267d34457e8 None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:36.380725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28d710-da12-4f32-8b06-f267d34457e8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:36.384542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 195/385] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:36 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:36.388283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d544434-e9c6-420c-b0b4-9581a99cfbc6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:36.541689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d544434-e9c6-420c-b0b4-9581a99cfbc6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:36.588029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7411-4c3f-4a05-8bd2-cef873f65a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:36.589261 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7411-4c3f-4a05-8bd2-cef873f65a59 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:36.589749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7411-4c3f-4a05-8bd2-cef873f65a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:36.590223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7411-4c3f-4a05-8bd2-cef873f65a59 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:36.591672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7411-4c3f-4a05-8bd2-cef873f65a59 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:36.593382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7411-4c3f-4a05-8bd2-cef873f65a59 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:36.596636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 191/386] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:36 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:36.596913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:36.604585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28d710-da12-4f32-8b06-f267d34457e8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:36.741604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28d710-da12-4f32-8b06-f267d34457e8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:36.776821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb18ac-598f-4c1d-92d0-2b7a2a57c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:36.778066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb18ac-598f-4c1d-92d0-2b7a2a57c8c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:36.778558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb18ac-598f-4c1d-92d0-2b7a2a57c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:36.779093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb18ac-598f-4c1d-92d0-2b7a2a57c8c4 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af/groups/6237e9b574ac4be38346ccd717a6eb44/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:36.781297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb18ac-598f-4c1d-92d0-2b7a2a57c8c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8867c613b3214d72b178a25b63c2e0af, group_id=6237e9b574ac4be38346ccd717a6eb44, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:36.783009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb18ac-598f-4c1d-92d0-2b7a2a57c8c4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:36.865565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 196/387] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 09:27:36 2022] PUT /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af/groups/6237e9b574ac4be38346ccd717a6eb44/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:37.037206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eef83-2f6c-4974-ab69-5fe409e73c8e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:37.037871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eef83-2f6c-4974-ab69-5fe409e73c8e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:37.038316 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eef83-2f6c-4974-ab69-5fe409e73c8e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:37.040233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 192/388] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:37.045644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aff6a-2e49-40f8-bb57-f471e5657625 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:37.045946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aff6a-2e49-40f8-bb57-f471e5657625 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:37.046230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aff6a-2e49-40f8-bb57-f471e5657625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:37.065723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d05aff6a-2e49-40f8-bb57-f471e5657625 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:37.066960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d05aff6a-2e49-40f8-bb57-f471e5657625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:37.126203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:37.142505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 197/389] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:37.167709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eef83-2f6c-4974-ab69-5fe409e73c8e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:37.296757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eef83-2f6c-4974-ab69-5fe409e73c8e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:37.339748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae4018-05b5-4103-a58c-1c4a89fec6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:37.340564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae4018-05b5-4103-a58c-1c4a89fec6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:37.340853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae4018-05b5-4103-a58c-1c4a89fec6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:37.341128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae4018-05b5-4103-a58c-1c4a89fec6e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:37.353579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae4018-05b5-4103-a58c-1c4a89fec6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-bcae4018-05b5-4103-a58c-1c4a89fec6e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:37.362759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:37.363689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:37.364476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:37.368385 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 193/390] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:37.370540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aff6a-2e49-40f8-bb57-f471e5657625 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:37.497088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aff6a-2e49-40f8-bb57-f471e5657625 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:37.537219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5921f-5322-4166-b094-1631a63997c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:37.537893 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5921f-5322-4166-b094-1631a63997c2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:37.538179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5921f-5322-4166-b094-1631a63997c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:37.538501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5921f-5322-4166-b094-1631a63997c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:37.539231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5921f-5322-4166-b094-1631a63997c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:37.539542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5921f-5322-4166-b094-1631a63997c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:37.540936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5921f-5322-4166-b094-1631a63997c2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:37.556385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 198/391] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:37.557736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae4018-05b5-4103-a58c-1c4a89fec6e1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:37.624209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:37.676511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae4018-05b5-4103-a58c-1c4a89fec6e1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:37.722436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a5efd-4065-4b52-91d0-932d9b13981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:37.723438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5efd-4065-4b52-91d0-932d9b13981c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:37.723775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5efd-4065-4b52-91d0-932d9b13981c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:37.724061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5efd-4065-4b52-91d0-932d9b13981c None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:37.725351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a5efd-4065-4b52-91d0-932d9b13981c None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:37.726933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a5efd-4065-4b52-91d0-932d9b13981c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:37.728779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 194/392] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:37 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:37.735104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5921f-5322-4166-b094-1631a63997c2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:37.806605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:37.860652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5921f-5322-4166-b094-1631a63997c2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:37.896923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ee7af-31d1-417b-8606-b4310502e9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:37.897800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ee7af-31d1-417b-8606-b4310502e9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:37.898087 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ee7af-31d1-417b-8606-b4310502e9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:37.898369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ee7af-31d1-417b-8606-b4310502e9d7 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:37.899684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ee7af-31d1-417b-8606-b4310502e9d7 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:37.901124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ee7af-31d1-417b-8606-b4310502e9d7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:37.906952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 199/393] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:37 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:37.908941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a5efd-4065-4b52-91d0-932d9b13981c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:37.984298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab83d3-67fb-4f77-b7e4-d1cc86f9f103 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:37.984653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab83d3-67fb-4f77-b7e4-d1cc86f9f103 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:37.984862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab83d3-67fb-4f77-b7e4-d1cc86f9f103 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:37.986373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 200/394] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:37.996061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fba4d-9737-46de-9665-cba3cc2160b7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:37.996354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fba4d-9737-46de-9665-cba3cc2160b7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:37.996645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fba4d-9737-46de-9665-cba3cc2160b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:38.026040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a5efd-4065-4b52-91d0-932d9b13981c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:38.031858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-527fba4d-9737-46de-9665-cba3cc2160b7 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:38.033074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-527fba4d-9737-46de-9665-cba3cc2160b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:38.061069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:38.070381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26629018-a617-47a8-85d6-c2f0f8036303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:38.074824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26629018-a617-47a8-85d6-c2f0f8036303 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:38.074824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26629018-a617-47a8-85d6-c2f0f8036303 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:38.074824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26629018-a617-47a8-85d6-c2f0f8036303 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af/groups/6237e9b574ac4be38346ccd717a6eb44/roles/3aed2722fbf34ba2bb24b1cb29d49004` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:38.074824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26629018-a617-47a8-85d6-c2f0f8036303 None admin] RBAC: Authorizing `identity:create_grant(project_id=8867c613b3214d72b178a25b63c2e0af, group_id=6237e9b574ac4be38346ccd717a6eb44, role_id=3aed2722fbf34ba2bb24b1cb29d49004)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:38.077134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26629018-a617-47a8-85d6-c2f0f8036303 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:38.155983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 201/395] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:38.184298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fba4d-9737-46de-9665-cba3cc2160b7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:38.203290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 195/396] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 09:27:37 2022] PUT /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af/groups/6237e9b574ac4be38346ccd717a6eb44/roles/3aed2722fbf34ba2bb24b1cb29d49004 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:38.258058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:38.335166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fba4d-9737-46de-9665-cba3cc2160b7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:38.386195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4beee-3c5d-431d-9a11-dff782c613d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:38.387891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4beee-3c5d-431d-9a11-dff782c613d6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:38.388375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4beee-3c5d-431d-9a11-dff782c613d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:38.388849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4beee-3c5d-431d-9a11-dff782c613d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:38.401111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd4beee-3c5d-431d-9a11-dff782c613d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-0dd4beee-3c5d-431d-9a11-dff782c613d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:38.418273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:38.419260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:38.420172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:38.422638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 202/397] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:27:38.428666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26629018-a617-47a8-85d6-c2f0f8036303 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:38.542507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26629018-a617-47a8-85d6-c2f0f8036303 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:38.582095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc157e5-0bd0-469e-87e8-971aa2295bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:38.582774 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc157e5-0bd0-469e-87e8-971aa2295bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:38.583149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc157e5-0bd0-469e-87e8-971aa2295bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:38.583493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc157e5-0bd0-469e-87e8-971aa2295bf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:38.584266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc157e5-0bd0-469e-87e8-971aa2295bf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:38.585659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc157e5-0bd0-469e-87e8-971aa2295bf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:38.586089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc157e5-0bd0-469e-87e8-971aa2295bf0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:38.595260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 196/398] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:38.601623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4beee-3c5d-431d-9a11-dff782c613d6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:38.745679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4beee-3c5d-431d-9a11-dff782c613d6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:38.756411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:38.783205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75ac6-cbe2-4cd0-bbac-0111d3fe8fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:38.784262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75ac6-cbe2-4cd0-bbac-0111d3fe8fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:38.784549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75ac6-cbe2-4cd0-bbac-0111d3fe8fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:38.784828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75ac6-cbe2-4cd0-bbac-0111d3fe8fd3 None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:38.786118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75ac6-cbe2-4cd0-bbac-0111d3fe8fd3 None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:38.787690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75ac6-cbe2-4cd0-bbac-0111d3fe8fd3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:38.790457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 203/399] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:38 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:38.795635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc157e5-0bd0-469e-87e8-971aa2295bf0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:38.822344 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7c9b-86a1-4bc3-9fc1-934eacf32b46 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:38.822649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7c9b-86a1-4bc3-9fc1-934eacf32b46 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:38.822940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a7c9b-86a1-4bc3-9fc1-934eacf32b46 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:38.824323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 204/400] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:38.829229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f5aa-cc05-4c9e-adfb-ec02d8c992ba None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:38.829515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f5aa-cc05-4c9e-adfb-ec02d8c992ba None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:38.829793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74f5aa-cc05-4c9e-adfb-ec02d8c992ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:38.860107 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5e74f5aa-cc05-4c9e-adfb-ec02d8c992ba None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:38.861222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5e74f5aa-cc05-4c9e-adfb-ec02d8c992ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:38.893153 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:38.982369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 205/401] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 09:27:38.983556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc157e5-0bd0-469e-87e8-971aa2295bf0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:38.984607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80c848-c7f4-488f-8a8d-9c16abb0c3e8 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:38.985095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80c848-c7f4-488f-8a8d-9c16abb0c3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:38.985571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80c848-c7f4-488f-8a8d-9c16abb0c3e8 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:38.990943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 206/402] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:38.993597 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c5d22-6500-40f2-8468-f3fd3bd1336d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:38.994007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c5d22-6500-40f2-8468-f3fd3bd1336d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:38.994393 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c5d22-6500-40f2-8468-f3fd3bd1336d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.020129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fd0c5d22-6500-40f2-8468-f3fd3bd1336d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:39.021533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fd0c5d22-6500-40f2-8468-f3fd3bd1336d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:39.026697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a566de-232d-4cbf-825f-06e1d30e708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:39.027638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a566de-232d-4cbf-825f-06e1d30e708d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.028153 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a566de-232d-4cbf-825f-06e1d30e708d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.028646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a566de-232d-4cbf-825f-06e1d30e708d None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.030472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a566de-232d-4cbf-825f-06e1d30e708d None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:39.031984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a566de-232d-4cbf-825f-06e1d30e708d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:39.035856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 197/403] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:38 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:39.036746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a566de-232d-4cbf-825f-06e1d30e708d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:39.098965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 207/404] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:39.100049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c5d22-6500-40f2-8468-f3fd3bd1336d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:39.144526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a566de-232d-4cbf-825f-06e1d30e708d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:39.153667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:39.164079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:39.181212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2313c-c6ac-4c62-941b-c37e5052dd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:39.182028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2313c-c6ac-4c62-941b-c37e5052dd51 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.182312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2313c-c6ac-4c62-941b-c37e5052dd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.182592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2313c-c6ac-4c62-941b-c37e5052dd51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.195410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2313c-c6ac-4c62-941b-c37e5052dd51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-92e2313c-c6ac-4c62-941b-c37e5052dd51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:39.204137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:39.206297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:39.208398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 198/405] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:39.214903 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2313c-c6ac-4c62-941b-c37e5052dd51 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:39.227188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c5d22-6500-40f2-8468-f3fd3bd1336d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:39.263779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27dbb-d206-45bd-8903-e6f4ef61a392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:39.264672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27dbb-d206-45bd-8903-e6f4ef61a392 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.264958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27dbb-d206-45bd-8903-e6f4ef61a392 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.265235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e27dbb-d206-45bd-8903-e6f4ef61a392 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc/groups/6237e9b574ac4be38346ccd717a6eb44/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.267415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27dbb-d206-45bd-8903-e6f4ef61a392 None admin] RBAC: Authorizing `identity:create_grant(project_id=a82eabb094424b2fbf694476a02fb1cc, group_id=6237e9b574ac4be38346ccd717a6eb44, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:39.269665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e27dbb-d206-45bd-8903-e6f4ef61a392 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:39.320683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2313c-c6ac-4c62-941b-c37e5052dd51 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:39.354878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9683e-238f-4673-8285-a7ce7196676c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:39.355676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9683e-238f-4673-8285-a7ce7196676c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.356003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9683e-238f-4673-8285-a7ce7196676c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.356291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9683e-238f-4673-8285-a7ce7196676c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.368305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda9683e-238f-4673-8285-a7ce7196676c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:39.369968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 208/406] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 09:27:39 2022] PUT /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc/groups/6237e9b574ac4be38346ccd717a6eb44/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:39.371933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27dbb-d206-45bd-8903-e6f4ef61a392 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-fda9683e-238f-4673-8285-a7ce7196676c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:39.376664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:39.378383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:39.384874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 199/407] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:27:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:39.392058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9683e-238f-4673-8285-a7ce7196676c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:39.474786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:39.511922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e27dbb-d206-45bd-8903-e6f4ef61a392 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:39.515227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:39.560460 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e23f1-7ca5-4b0a-aabc-c4c6d9226c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:39.561781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e23f1-7ca5-4b0a-aabc-c4c6d9226c76 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.562267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e23f1-7ca5-4b0a-aabc-c4c6d9226c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.562942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e23f1-7ca5-4b0a-aabc-c4c6d9226c76 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.564365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e23f1-7ca5-4b0a-aabc-c4c6d9226c76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:39.565009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e23f1-7ca5-4b0a-aabc-c4c6d9226c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:39.567103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e23f1-7ca5-4b0a-aabc-c4c6d9226c76 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:39.572540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9683e-238f-4673-8285-a7ce7196676c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:39.577955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 209/408] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:39.584010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e23f1-7ca5-4b0a-aabc-c4c6d9226c76 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:39.622279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647d7d-09da-4a9a-9294-bd5cfcd7f9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:39.623192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647d7d-09da-4a9a-9294-bd5cfcd7f9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.623759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647d7d-09da-4a9a-9294-bd5cfcd7f9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.624043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff647d7d-09da-4a9a-9294-bd5cfcd7f9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.624804 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff647d7d-09da-4a9a-9294-bd5cfcd7f9b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:39.625125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff647d7d-09da-4a9a-9294-bd5cfcd7f9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:39.626530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff647d7d-09da-4a9a-9294-bd5cfcd7f9b4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:39.647020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 200/409] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:39.667910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647d7d-09da-4a9a-9294-bd5cfcd7f9b4 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:39.715137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e23f1-7ca5-4b0a-aabc-c4c6d9226c76 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:39.756862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd257b-9874-47b6-94e8-87ef60d97f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:39.757659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd257b-9874-47b6-94e8-87ef60d97f11 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.757945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd257b-9874-47b6-94e8-87ef60d97f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.758222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd257b-9874-47b6-94e8-87ef60d97f11 None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.759709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd257b-9874-47b6-94e8-87ef60d97f11 None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:39.761688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd257b-9874-47b6-94e8-87ef60d97f11 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:39.764072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 210/410] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:39 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:39.771863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd257b-9874-47b6-94e8-87ef60d97f11 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:39.843246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:39.851515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:39.854393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff647d7d-09da-4a9a-9294-bd5cfcd7f9b4 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:39.914554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef074c-4399-46b7-8f04-68739adc8365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:39.915506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef074c-4399-46b7-8f04-68739adc8365 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.915793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef074c-4399-46b7-8f04-68739adc8365 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.916070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef074c-4399-46b7-8f04-68739adc8365 None admin] PATH_INFO: `/v3/groups/aec009f49af34d9d85aef6a4ea2e4079` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.917261 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef074c-4399-46b7-8f04-68739adc8365 None admin] RBAC: Authorizing `identity:get_group(group_id=aec009f49af34d9d85aef6a4ea2e4079)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:39.918832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef074c-4399-46b7-8f04-68739adc8365 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:39.920515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 201/411] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:39 2022] GET /identity/v3/groups/aec009f49af34d9d85aef6a4ea2e4079 => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:39.930866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef074c-4399-46b7-8f04-68739adc8365 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:39.940857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd257b-9874-47b6-94e8-87ef60d97f11 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:39.986088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453fc74-4ee4-4224-8751-962a1a95ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:39.987423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453fc74-4ee4-4224-8751-962a1a95ab03 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.987886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453fc74-4ee4-4224-8751-962a1a95ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.988736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453fc74-4ee4-4224-8751-962a1a95ab03 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.990354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453fc74-4ee4-4224-8751-962a1a95ab03 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:39.992457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453fc74-4ee4-4224-8751-962a1a95ab03 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:39.994750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 211/412] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:39 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:39.996634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb18be-ab05-4a70-81f9-7e0d6c0181f8 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:39.997059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb18be-ab05-4a70-81f9-7e0d6c0181f8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:39.997462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb18be-ab05-4a70-81f9-7e0d6c0181f8 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:39.999132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 212/413] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:40.000863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb18be-ab05-4a70-81f9-7e0d6c0181f8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:40.044199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef074c-4399-46b7-8f04-68739adc8365 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:40.086137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1eb23-cec6-44ee-bc4d-0fd50fc37630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:40.087230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1eb23-cec6-44ee-bc4d-0fd50fc37630 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:40.087658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1eb23-cec6-44ee-bc4d-0fd50fc37630 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:40.088060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1eb23-cec6-44ee-bc4d-0fd50fc37630 None admin] PATH_INFO: `/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:40.089600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1eb23-cec6-44ee-bc4d-0fd50fc37630 None admin] RBAC: Authorizing `identity:get_project(project_id=ecfbe47b81cd4fe29763116c4e6fcb19)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:40.091041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1eb23-cec6-44ee-bc4d-0fd50fc37630 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:40.092871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 202/414] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:39 2022] GET /identity/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:40.098404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae71a61-f029-45b6-9f2b-5734dac91eb3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:40.098404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae71a61-f029-45b6-9f2b-5734dac91eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:40.098404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae71a61-f029-45b6-9f2b-5734dac91eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:40.115483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6ae71a61-f029-45b6-9f2b-5734dac91eb3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:40.116825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6ae71a61-f029-45b6-9f2b-5734dac91eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:40.137511 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb18be-ab05-4a70-81f9-7e0d6c0181f8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:40.139839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:40.150193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:40.193651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78df82-0b41-44c2-8814-766ef7646ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:40.195201 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78df82-0b41-44c2-8814-766ef7646ab5 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:40.195629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78df82-0b41-44c2-8814-766ef7646ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:40.196077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78df82-0b41-44c2-8814-766ef7646ab5 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc/groups/6237e9b574ac4be38346ccd717a6eb44/roles/3aed2722fbf34ba2bb24b1cb29d49004` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:40.196896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 203/415] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:40.197915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae71a61-f029-45b6-9f2b-5734dac91eb3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:40.199061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78df82-0b41-44c2-8814-766ef7646ab5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a82eabb094424b2fbf694476a02fb1cc, group_id=6237e9b574ac4be38346ccd717a6eb44, role_id=3aed2722fbf34ba2bb24b1cb29d49004)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:40.201065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78df82-0b41-44c2-8814-766ef7646ab5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:40.262828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 213/416] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 09:27:39 2022] PUT /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc/groups/6237e9b574ac4be38346ccd717a6eb44/roles/3aed2722fbf34ba2bb24b1cb29d49004 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:40.264213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78df82-0b41-44c2-8814-766ef7646ab5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:40.349987 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae71a61-f029-45b6-9f2b-5734dac91eb3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:40.400224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78df82-0b41-44c2-8814-766ef7646ab5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:40.443864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd538-b628-4b78-aef4-da7105f92f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:40.444986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd538-b628-4b78-aef4-da7105f92f38 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:40.445442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd538-b628-4b78-aef4-da7105f92f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:40.445912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fd538-b628-4b78-aef4-da7105f92f38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:40.457763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f5fef-0559-49f1-b908-120e062640bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:40.458684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f5fef-0559-49f1-b908-120e062640bd None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:40.459008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f5fef-0559-49f1-b908-120e062640bd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:40.459287 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f5fef-0559-49f1-b908-120e062640bd None admin] PATH_INFO: `/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19/groups/aec009f49af34d9d85aef6a4ea2e4079/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:40.461275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fd538-b628-4b78-aef4-da7105f92f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:40.467704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f5fef-0559-49f1-b908-120e062640bd None admin] RBAC: Authorizing `identity:create_grant(project_id=ecfbe47b81cd4fe29763116c4e6fcb19, group_id=aec009f49af34d9d85aef6a4ea2e4079, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:40.469192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f5fef-0559-49f1-b908-120e062640bd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-3a8fd538-b628-4b78-aef4-da7105f92f38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:40.470042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:40.471075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:40.472686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:40.479490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 214/417] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:40.482099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd538-b628-4b78-aef4-da7105f92f38 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:40.500463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:40.569208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 204/418] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 09:27:40 2022] PUT /identity/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19/groups/aec009f49af34d9d85aef6a4ea2e4079/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:40.594028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fd538-b628-4b78-aef4-da7105f92f38 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:40.632481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1521e7-f51d-4902-b4e1-65f0fffe931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:40.633085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1521e7-f51d-4902-b4e1-65f0fffe931f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:40.633381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1521e7-f51d-4902-b4e1-65f0fffe931f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:40.633658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1521e7-f51d-4902-b4e1-65f0fffe931f None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:40.634417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1521e7-f51d-4902-b4e1-65f0fffe931f None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:40.634729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1521e7-f51d-4902-b4e1-65f0fffe931f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:40.636135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1521e7-f51d-4902-b4e1-65f0fffe931f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:40.647446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 215/419] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:40.652926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f5fef-0559-49f1-b908-120e062640bd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:40.694822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:40.774210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01056233-8735-40c5-856d-f346ec073134 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:40.774498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01056233-8735-40c5-856d-f346ec073134 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:40.774781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01056233-8735-40c5-856d-f346ec073134 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:40.776493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 216/420] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:40.784476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299a6ba-6539-43a2-9242-647c5c8471ba None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:40.784813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299a6ba-6539-43a2-9242-647c5c8471ba None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:40.785049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299a6ba-6539-43a2-9242-647c5c8471ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:40.804727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e299a6ba-6539-43a2-9242-647c5c8471ba None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:40.805791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f5fef-0559-49f1-b908-120e062640bd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:40.805975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e299a6ba-6539-43a2-9242-647c5c8471ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:40.848319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7620c-8fa2-47f1-b808-d65333caeaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:40.849078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7620c-8fa2-47f1-b808-d65333caeaed None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:40.849369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7620c-8fa2-47f1-b808-d65333caeaed None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:40.849648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7620c-8fa2-47f1-b808-d65333caeaed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:40.891818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 217/421] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:40.918784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299a6ba-6539-43a2-9242-647c5c8471ba None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:40.928563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:40.949916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7620c-8fa2-47f1-b808-d65333caeaed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:40.951621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7620c-8fa2-47f1-b808-d65333caeaed None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:41.015210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:41.108359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 205/422] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:41.114742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7620c-8fa2-47f1-b808-d65333caeaed None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:41.136739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299a6ba-6539-43a2-9242-647c5c8471ba None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:41.213147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a31a23-61be-4d38-9b64-7a15a26e977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:41.214162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a31a23-61be-4d38-9b64-7a15a26e977f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:41.214453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a31a23-61be-4d38-9b64-7a15a26e977f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:41.214731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a31a23-61be-4d38-9b64-7a15a26e977f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:41.237403 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a31a23-61be-4d38-9b64-7a15a26e977f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:41.252837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7620c-8fa2-47f1-b808-d65333caeaed None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a3a31a23-61be-4d38-9b64-7a15a26e977f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:41.254554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:41.255475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:41.256245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 218/423] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:41.263023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a31a23-61be-4d38-9b64-7a15a26e977f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:41.299739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:41.317066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28d099-82eb-4a61-9037-d6e9c71c40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:41.318241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28d099-82eb-4a61-9037-d6e9c71c40d3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:41.322531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28d099-82eb-4a61-9037-d6e9c71c40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:41.322531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28d099-82eb-4a61-9037-d6e9c71c40d3 None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:41.323596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28d099-82eb-4a61-9037-d6e9c71c40d3 None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:41.325076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28d099-82eb-4a61-9037-d6e9c71c40d3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:41.326824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 206/424] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:41 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:41.340988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28d099-82eb-4a61-9037-d6e9c71c40d3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:41.353976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:41.391132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a31a23-61be-4d38-9b64-7a15a26e977f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:41.427825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e550b53-99a8-4309-bc97-e023e971d7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:41.428499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e550b53-99a8-4309-bc97-e023e971d7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:41.428788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e550b53-99a8-4309-bc97-e023e971d7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:41.429226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e550b53-99a8-4309-bc97-e023e971d7d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:41.430622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e550b53-99a8-4309-bc97-e023e971d7d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:41.431120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e550b53-99a8-4309-bc97-e023e971d7d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:41.432682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e550b53-99a8-4309-bc97-e023e971d7d1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:41.443751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 219/425] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:41.449415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e550b53-99a8-4309-bc97-e023e971d7d1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:41.570187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28d099-82eb-4a61-9037-d6e9c71c40d3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:41.623600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd840-305d-4bc1-b233-45ae980bc50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:41.624495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd840-305d-4bc1-b233-45ae980bc50f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:41.624783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd840-305d-4bc1-b233-45ae980bc50f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:41.625064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd840-305d-4bc1-b233-45ae980bc50f None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:41.627665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd840-305d-4bc1-b233-45ae980bc50f None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:41.629183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd840-305d-4bc1-b233-45ae980bc50f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:41.631138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 207/426] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:41 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:41.648612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd840-305d-4bc1-b233-45ae980bc50f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:41.690714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e550b53-99a8-4309-bc97-e023e971d7d1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:41.726866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:41.731821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbeb987-35de-42b9-8501-8d0e12d5a0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:41.732488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb987-35de-42b9-8501-8d0e12d5a0ea None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:41.732772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb987-35de-42b9-8501-8d0e12d5a0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:41.733052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbeb987-35de-42b9-8501-8d0e12d5a0ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:41.799559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:41.845373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeb987-35de-42b9-8501-8d0e12d5a0ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:41.847966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbeb987-35de-42b9-8501-8d0e12d5a0ea None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:41.924962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd840-305d-4bc1-b233-45ae980bc50f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:41.962293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04914d1b-02f3-403c-b1eb-9b2ff5346ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:41.963393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04914d1b-02f3-403c-b1eb-9b2ff5346ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:41.963657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04914d1b-02f3-403c-b1eb-9b2ff5346ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:41.964013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04914d1b-02f3-403c-b1eb-9b2ff5346ff5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:41.964913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04914d1b-02f3-403c-b1eb-9b2ff5346ff5 None admin] RBAC: Adding query filter params (group.id=6237e9b574ac4be38346ccd717a6eb44, role.id=67691f718ae34424ae84912841aee8df, scope.project.id=8867c613b3214d72b178a25b63c2e0af) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:41.965301 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04914d1b-02f3-403c-b1eb-9b2ff5346ff5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:41.967031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04914d1b-02f3-403c-b1eb-9b2ff5346ff5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:41.972314 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 220/427] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:41.973978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6dcc-2b88-4456-9345-1c1f55fd77a0 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:41.974491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6dcc-2b88-4456-9345-1c1f55fd77a0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:41.974957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6dcc-2b88-4456-9345-1c1f55fd77a0 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:41.976933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 221/428] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:41.977866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae6dcc-2b88-4456-9345-1c1f55fd77a0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:41.979269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 208/429] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:41 2022] GET /identity/v3/role_assignments?group.id=6237e9b574ac4be38346ccd717a6eb44&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=67691f718ae34424ae84912841aee8df => generated 611 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:41.993759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c19e4-e45a-494d-8ae9-d44ecc148f42 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:41.994138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c19e4-e45a-494d-8ae9-d44ecc148f42 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:41.994499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c19e4-e45a-494d-8ae9-d44ecc148f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:42.012177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:42.027937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-247c19e4-e45a-494d-8ae9-d44ecc148f42 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:42.029246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-247c19e4-e45a-494d-8ae9-d44ecc148f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:42.103085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae6dcc-2b88-4456-9345-1c1f55fd77a0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:42.143793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5ad44-fe9a-4538-b396-c840aa965e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:42.144999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5ad44-fe9a-4538-b396-c840aa965e4b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:42.145692 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5ad44-fe9a-4538-b396-c840aa965e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:42.146150 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5ad44-fe9a-4538-b396-c840aa965e4b None admin] PATH_INFO: `/v3/projects/8867c613b3214d72b178a25b63c2e0af` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:42.148649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5ad44-fe9a-4538-b396-c840aa965e4b None admin] RBAC: Authorizing `identity:get_project(project_id=8867c613b3214d72b178a25b63c2e0af)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:42.150401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5ad44-fe9a-4538-b396-c840aa965e4b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:42.152637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 222/430] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:41 2022] GET /identity/v3/projects/8867c613b3214d72b178a25b63c2e0af => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:42.157741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5ad44-fe9a-4538-b396-c840aa965e4b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:42.211084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 209/431] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:42.235472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c19e4-e45a-494d-8ae9-d44ecc148f42 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:42.295220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:42.296682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:42.302878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5ad44-fe9a-4538-b396-c840aa965e4b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:42.340557 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e88941-8428-44bd-9d62-4b4438ab426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:42.341702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e88941-8428-44bd-9d62-4b4438ab426b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:42.342141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e88941-8428-44bd-9d62-4b4438ab426b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:42.342266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c19e4-e45a-494d-8ae9-d44ecc148f42 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:42.342722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e88941-8428-44bd-9d62-4b4438ab426b None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:42.344484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e88941-8428-44bd-9d62-4b4438ab426b None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:42.346770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e88941-8428-44bd-9d62-4b4438ab426b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:42.349887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 223/432] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:42 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:42.357422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e88941-8428-44bd-9d62-4b4438ab426b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:42.387564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00aba9-ba6d-4feb-a7a1-9614039f88dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:42.388469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00aba9-ba6d-4feb-a7a1-9614039f88dc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:42.388827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00aba9-ba6d-4feb-a7a1-9614039f88dc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:42.389283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00aba9-ba6d-4feb-a7a1-9614039f88dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:42.402576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00aba9-ba6d-4feb-a7a1-9614039f88dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-6e00aba9-ba6d-4feb-a7a1-9614039f88dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:42.412066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:42.413226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 09:27:42.414228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:42.420877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 210/433] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:42.422027 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00aba9-ba6d-4feb-a7a1-9614039f88dc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:42.483938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e88941-8428-44bd-9d62-4b4438ab426b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:42.528425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54115677-29ed-44e7-9132-cc5be7ecac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:42.529844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54115677-29ed-44e7-9132-cc5be7ecac47 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:42.530349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54115677-29ed-44e7-9132-cc5be7ecac47 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:42.530978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54115677-29ed-44e7-9132-cc5be7ecac47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:42.532120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54115677-29ed-44e7-9132-cc5be7ecac47 None admin] RBAC: Adding query filter params (group.id=6237e9b574ac4be38346ccd717a6eb44, role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=8867c613b3214d72b178a25b63c2e0af) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:42.532788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54115677-29ed-44e7-9132-cc5be7ecac47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:42.535198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54115677-29ed-44e7-9132-cc5be7ecac47 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:42.542446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00aba9-ba6d-4feb-a7a1-9614039f88dc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:42.543766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 224/434] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:42 2022] GET /identity/v3/role_assignments?group.id=6237e9b574ac4be38346ccd717a6eb44&scope.project.id=8867c613b3214d72b178a25b63c2e0af&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:42.563821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:42.586500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e430925-4b8d-4818-a9d0-d28fafecdc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:42.587623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e430925-4b8d-4818-a9d0-d28fafecdc16 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:42.587976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e430925-4b8d-4818-a9d0-d28fafecdc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:42.588327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e430925-4b8d-4818-a9d0-d28fafecdc16 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:42.589172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e430925-4b8d-4818-a9d0-d28fafecdc16 None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:42.590114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e430925-4b8d-4818-a9d0-d28fafecdc16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:42.591645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e430925-4b8d-4818-a9d0-d28fafecdc16 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:42.603057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 211/435] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:27:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:42.608988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54115677-29ed-44e7-9132-cc5be7ecac47 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:42.648122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:42.676504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877648e-176b-4ef1-bc9e-15fa6ee1a84e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:42.676831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877648e-176b-4ef1-bc9e-15fa6ee1a84e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:42.677054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877648e-176b-4ef1-bc9e-15fa6ee1a84e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:42.678461 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 212/436] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:42.684931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378d8f4-8b58-4621-a562-fa358ee68e1a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:42.685215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378d8f4-8b58-4621-a562-fa358ee68e1a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:42.685479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378d8f4-8b58-4621-a562-fa358ee68e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:42.704381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3378d8f4-8b58-4621-a562-fa358ee68e1a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:42.706149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3378d8f4-8b58-4621-a562-fa358ee68e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:42.745558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54115677-29ed-44e7-9132-cc5be7ecac47 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:42.797944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 213/437] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:42.798130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467551d6-2a83-4092-a45b-81cf053effa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:42.798741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467551d6-2a83-4092-a45b-81cf053effa6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:42.799067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467551d6-2a83-4092-a45b-81cf053effa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:42.799621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467551d6-2a83-4092-a45b-81cf053effa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:42.823922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378d8f4-8b58-4621-a562-fa358ee68e1a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:42.890324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467551d6-2a83-4092-a45b-81cf053effa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:42.892630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467551d6-2a83-4092-a45b-81cf053effa6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:42.930485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:42.968728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378d8f4-8b58-4621-a562-fa358ee68e1a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:42.979149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:43.010397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d5a8f-6762-4d9a-80da-bd05b695036e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.011329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5a8f-6762-4d9a-80da-bd05b695036e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.011613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5a8f-6762-4d9a-80da-bd05b695036e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.012135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5a8f-6762-4d9a-80da-bd05b695036e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.023448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 225/438] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:43.025183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b69a1-2c11-453a-ae23-311b0e634633 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.025480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b69a1-2c11-453a-ae23-311b0e634633 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.025764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b69a1-2c11-453a-ae23-311b0e634633 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.034270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d5a8f-6762-4d9a-80da-bd05b695036e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:43.034506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 226/439] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:43.034506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7433fb-77d7-4461-a1dd-130ed99cbdf1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.034506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7433fb-77d7-4461-a1dd-130ed99cbdf1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.034506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7433fb-77d7-4461-a1dd-130ed99cbdf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e25d5a8f-6762-4d9a-80da-bd05b695036e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:43.035479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:43.038613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 214/440] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:43.040712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d5a8f-6762-4d9a-80da-bd05b695036e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.059042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9d7433fb-77d7-4461-a1dd-130ed99cbdf1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:43.060325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9d7433fb-77d7-4461-a1dd-130ed99cbdf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:43.129046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 227/441] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:43.129883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7433fb-77d7-4461-a1dd-130ed99cbdf1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.155738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d5a8f-6762-4d9a-80da-bd05b695036e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:43.187206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:43.189695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46856d58-ae5b-45c2-8a09-cf83dc7d09eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.191160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46856d58-ae5b-45c2-8a09-cf83dc7d09eb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.191442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46856d58-ae5b-45c2-8a09-cf83dc7d09eb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.191715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46856d58-ae5b-45c2-8a09-cf83dc7d09eb None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.192892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46856d58-ae5b-45c2-8a09-cf83dc7d09eb None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:43.194333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46856d58-ae5b-45c2-8a09-cf83dc7d09eb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:43.196038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 215/442] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:43.198406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46856d58-ae5b-45c2-8a09-cf83dc7d09eb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.229162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7433fb-77d7-4461-a1dd-130ed99cbdf1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:43.234633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:43.263771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a03277-04a0-4747-96cc-cb7938131528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.264613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a03277-04a0-4747-96cc-cb7938131528 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.264964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a03277-04a0-4747-96cc-cb7938131528 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.265302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a03277-04a0-4747-96cc-cb7938131528 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.266122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a03277-04a0-4747-96cc-cb7938131528 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:43.266582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a03277-04a0-4747-96cc-cb7938131528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:43.268507 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a03277-04a0-4747-96cc-cb7938131528 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:43.277391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 228/443] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:43.278167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a03277-04a0-4747-96cc-cb7938131528 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.302977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46856d58-ae5b-45c2-8a09-cf83dc7d09eb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:43.337946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf2bf-1521-43d8-b94d-021b4a74cd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.338741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf2bf-1521-43d8-b94d-021b4a74cd7b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.339061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf2bf-1521-43d8-b94d-021b4a74cd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.339342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf2bf-1521-43d8-b94d-021b4a74cd7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.349813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cf2bf-1521-43d8-b94d-021b4a74cd7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-348cf2bf-1521-43d8-b94d-021b4a74cd7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:43.357657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:43.359030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:43.359846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 216/444] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:43.360484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf2bf-1521-43d8-b94d-021b4a74cd7b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.381226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a03277-04a0-4747-96cc-cb7938131528 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:43.400802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:43.419011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc944e87-b1df-43e2-af6a-1a0a19b3ac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.419011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc944e87-b1df-43e2-af6a-1a0a19b3ac9c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.419011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc944e87-b1df-43e2-af6a-1a0a19b3ac9c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.419011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc944e87-b1df-43e2-af6a-1a0a19b3ac9c None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.419639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc944e87-b1df-43e2-af6a-1a0a19b3ac9c None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:43.419639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc944e87-b1df-43e2-af6a-1a0a19b3ac9c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:43.421157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 229/445] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:43.421912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc944e87-b1df-43e2-af6a-1a0a19b3ac9c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.457688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:43.462815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf2bf-1521-43d8-b94d-021b4a74cd7b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:43.495952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dee60-b789-4e60-8c0e-b0a27b8a5cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.496599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dee60-b789-4e60-8c0e-b0a27b8a5cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.496881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dee60-b789-4e60-8c0e-b0a27b8a5cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.497158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dee60-b789-4e60-8c0e-b0a27b8a5cf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.520958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc944e87-b1df-43e2-af6a-1a0a19b3ac9c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:43.552715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8867d-39c2-4b3f-b3d4-08ae48a3a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.553369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8867d-39c2-4b3f-b3d4-08ae48a3a01e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.553653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8867d-39c2-4b3f-b3d4-08ae48a3a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.553928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8867d-39c2-4b3f-b3d4-08ae48a3a01e None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.554661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8867d-39c2-4b3f-b3d4-08ae48a3a01e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:43.554998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8867d-39c2-4b3f-b3d4-08ae48a3a01e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:43.556358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8867d-39c2-4b3f-b3d4-08ae48a3a01e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:43.564239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dee60-b789-4e60-8c0e-b0a27b8a5cf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:43.569645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 230/446] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:43.569645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8867d-39c2-4b3f-b3d4-08ae48a3a01e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.569857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dee60-b789-4e60-8c0e-b0a27b8a5cf9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:43.618725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:43.661551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:43.667984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8867d-39c2-4b3f-b3d4-08ae48a3a01e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:43.672820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 217/447] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:43.672820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dee60-b789-4e60-8c0e-b0a27b8a5cf9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.701249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ecd5f-4a6f-4675-be46-2fc575d0938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.701898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecd5f-4a6f-4675-be46-2fc575d0938c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.702180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecd5f-4a6f-4675-be46-2fc575d0938c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.702456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecd5f-4a6f-4675-be46-2fc575d0938c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.703321 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ecd5f-4a6f-4675-be46-2fc575d0938c None admin] RBAC: Adding query filter params (group.id=6237e9b574ac4be38346ccd717a6eb44, role.id=67691f718ae34424ae84912841aee8df, scope.project.id=a82eabb094424b2fbf694476a02fb1cc) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:43.703640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ecd5f-4a6f-4675-be46-2fc575d0938c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:43.705070 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ecd5f-4a6f-4675-be46-2fc575d0938c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:43.711624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 231/448] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/role_assignments?group.id=6237e9b574ac4be38346ccd717a6eb44&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=67691f718ae34424ae84912841aee8df => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:43.712708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ecd5f-4a6f-4675-be46-2fc575d0938c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.780419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dee60-b789-4e60-8c0e-b0a27b8a5cf9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:43.819421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f8166-08c1-42b4-9e62-d462d35ebc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.820094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f8166-08c1-42b4-9e62-d462d35ebc4d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.820378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f8166-08c1-42b4-9e62-d462d35ebc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.820658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f8166-08c1-42b4-9e62-d462d35ebc4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.827206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ecd5f-4a6f-4675-be46-2fc575d0938c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:43.842095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:43.865277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52ec44-00ce-408f-a381-5a2499df4859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:43.866039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52ec44-00ce-408f-a381-5a2499df4859 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:43.866333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52ec44-00ce-408f-a381-5a2499df4859 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:43.866612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52ec44-00ce-408f-a381-5a2499df4859 None admin] PATH_INFO: `/v3/projects/a82eabb094424b2fbf694476a02fb1cc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:43.868974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52ec44-00ce-408f-a381-5a2499df4859 None admin] RBAC: Authorizing `identity:get_project(project_id=a82eabb094424b2fbf694476a02fb1cc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:43.870415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be52ec44-00ce-408f-a381-5a2499df4859 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:43.872346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 232/449] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/projects/a82eabb094424b2fbf694476a02fb1cc => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:43.879007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52ec44-00ce-408f-a381-5a2499df4859 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:43.897016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:43.904489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f8166-08c1-42b4-9e62-d462d35ebc4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:43.905982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f8166-08c1-42b4-9e62-d462d35ebc4d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:44.002995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be52ec44-00ce-408f-a381-5a2499df4859 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:44.029662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 218/450] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:44.035586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f8166-08c1-42b4-9e62-d462d35ebc4d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:44.043861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410bbf0-28d5-434b-9f77-a40213efd01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:44.044731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410bbf0-28d5-434b-9f77-a40213efd01d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:44.045015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410bbf0-28d5-434b-9f77-a40213efd01d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:44.045294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410bbf0-28d5-434b-9f77-a40213efd01d None admin] PATH_INFO: `/v3/groups/6237e9b574ac4be38346ccd717a6eb44` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:44.046818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410bbf0-28d5-434b-9f77-a40213efd01d None admin] RBAC: Authorizing `identity:get_group(group_id=6237e9b574ac4be38346ccd717a6eb44)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:44.048596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410bbf0-28d5-434b-9f77-a40213efd01d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:44.051030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 233/451] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:43 2022] GET /identity/v3/groups/6237e9b574ac4be38346ccd717a6eb44 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:44.056973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410bbf0-28d5-434b-9f77-a40213efd01d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:44.123570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:44.144788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:44.150428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f8166-08c1-42b4-9e62-d462d35ebc4d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:44.169930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410bbf0-28d5-434b-9f77-a40213efd01d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:44.183187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6f4dc-3bfb-4c23-949a-e3005c21488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:44.184151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6f4dc-3bfb-4c23-949a-e3005c21488c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:44.184497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6f4dc-3bfb-4c23-949a-e3005c21488c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:44.184778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6f4dc-3bfb-4c23-949a-e3005c21488c None admin] PATH_INFO: `/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:44.185970 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6f4dc-3bfb-4c23-949a-e3005c21488c None admin] RBAC: Authorizing `identity:get_project(project_id=ecfbe47b81cd4fe29763116c4e6fcb19)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:44.187464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c6f4dc-3bfb-4c23-949a-e3005c21488c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:44.194242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 219/452] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:27:44 2022] GET /identity/v3/projects/ecfbe47b81cd4fe29763116c4e6fcb19 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:44.195115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6f4dc-3bfb-4c23-949a-e3005c21488c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:44.206196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5b6cb-3845-48fa-929b-047b913ea431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:44.206922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5b6cb-3845-48fa-929b-047b913ea431 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:44.207246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5b6cb-3845-48fa-929b-047b913ea431 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:44.207528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5b6cb-3845-48fa-929b-047b913ea431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:44.208375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5b6cb-3845-48fa-929b-047b913ea431 None admin] RBAC: Adding query filter params (group.id=6237e9b574ac4be38346ccd717a6eb44, role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=a82eabb094424b2fbf694476a02fb1cc) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:44.208690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5b6cb-3845-48fa-929b-047b913ea431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:44.210125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5b6cb-3845-48fa-929b-047b913ea431 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:44.215903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 234/453] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:44 2022] GET /identity/v3/role_assignments?group.id=6237e9b574ac4be38346ccd717a6eb44&scope.project.id=a82eabb094424b2fbf694476a02fb1cc&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:44.300393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6f4dc-3bfb-4c23-949a-e3005c21488c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:44.339262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f850f4c-33a9-47dc-861c-e1f0d87a16dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:44.340129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850f4c-33a9-47dc-861c-e1f0d87a16dd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:44.340411 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850f4c-33a9-47dc-861c-e1f0d87a16dd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:44.340687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f850f4c-33a9-47dc-861c-e1f0d87a16dd None admin] PATH_INFO: `/v3/groups/aec009f49af34d9d85aef6a4ea2e4079` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:44.341912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f850f4c-33a9-47dc-861c-e1f0d87a16dd None admin] RBAC: Authorizing `identity:get_group(group_id=aec009f49af34d9d85aef6a4ea2e4079)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:44.343451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f850f4c-33a9-47dc-861c-e1f0d87a16dd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:44.345284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 220/454] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 09:27:44 2022] GET /identity/v3/groups/aec009f49af34d9d85aef6a4ea2e4079 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:44.351875 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5b6cb-3845-48fa-929b-047b913ea431 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:44.459100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5b6cb-3845-48fa-929b-047b913ea431 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:44.472825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:44.493254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff6d6e-2fb9-4433-beaa-05cc112cf093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:44.493917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff6d6e-2fb9-4433-beaa-05cc112cf093 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:44.494204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff6d6e-2fb9-4433-beaa-05cc112cf093 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:44.494484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff6d6e-2fb9-4433-beaa-05cc112cf093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:44.495352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff6d6e-2fb9-4433-beaa-05cc112cf093 None admin] RBAC: Adding query filter params (group.id=aec009f49af34d9d85aef6a4ea2e4079, role.id=9312183c32b04118985c8316f33f3830, scope.project.id=ecfbe47b81cd4fe29763116c4e6fcb19) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:44.495668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff6d6e-2fb9-4433-beaa-05cc112cf093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:44.497872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff6d6e-2fb9-4433-beaa-05cc112cf093 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:44.503656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 235/455] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 09:27:44 2022] GET /identity/v3/role_assignments?group.id=aec009f49af34d9d85aef6a4ea2e4079&scope.project.id=ecfbe47b81cd4fe29763116c4e6fcb19&role.id=9312183c32b04118985c8316f33f3830 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:46.939333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ac7f3-7451-40d9-b0e2-9f4ba690f20c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:46.939861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ac7f3-7451-40d9-b0e2-9f4ba690f20c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:46.939861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ac7f3-7451-40d9-b0e2-9f4ba690f20c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:46.942034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 221/456] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:46.947306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71f5a4-7f93-4345-8020-72c976ed7f6e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:46.947712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71f5a4-7f93-4345-8020-72c976ed7f6e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:46.947872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71f5a4-7f93-4345-8020-72c976ed7f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:46.975942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4e71f5a4-7f93-4345-8020-72c976ed7f6e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:46.977157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4e71f5a4-7f93-4345-8020-72c976ed7f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:47.072495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 236/457] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:47.088248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a93442-bd3e-4afc-a024-f3fba87543e1 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.093905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a93442-bd3e-4afc-a024-f3fba87543e1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.093905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a93442-bd3e-4afc-a024-f3fba87543e1 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.093905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 222/458] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:47.097744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeb4d1-b5ea-427e-b64f-2a215e8091e9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.098057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeb4d1-b5ea-427e-b64f-2a215e8091e9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.098350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aeb4d1-b5ea-427e-b64f-2a215e8091e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.107271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a93442-bd3e-4afc-a024-f3fba87543e1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:47.124455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b8aeb4d1-b5ea-427e-b64f-2a215e8091e9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:47.125657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b8aeb4d1-b5ea-427e-b64f-2a215e8091e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:47.167205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:47.254462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 237/459] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:47.256354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac123f-dbfd-4a03-99e5-805aa8898564 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.256855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac123f-dbfd-4a03-99e5-805aa8898564 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.257341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac123f-dbfd-4a03-99e5-805aa8898564 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.259172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 238/460] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:47.264934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93ec1-0873-4a03-87dc-ae14ebd70e41 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.265749 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93ec1-0873-4a03-87dc-ae14ebd70e41 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.266486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d93ec1-0873-4a03-87dc-ae14ebd70e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.270560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a93442-bd3e-4afc-a024-f3fba87543e1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:47.296163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-13d93ec1-0873-4a03-87dc-ae14ebd70e41 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:47.297602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-13d93ec1-0873-4a03-87dc-ae14ebd70e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:47.313593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05ea54-08ce-449f-ab04-c8fc25265649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:47.314517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05ea54-08ce-449f-ab04-c8fc25265649 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.315479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05ea54-08ce-449f-ab04-c8fc25265649 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.315851 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05ea54-08ce-449f-ab04-c8fc25265649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.327288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05ea54-08ce-449f-ab04-c8fc25265649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:47.328884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05ea54-08ce-449f-ab04-c8fc25265649 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:47.330312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-af05ea54-08ce-449f-ab04-c8fc25265649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:47.352112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:47.353115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:47.354005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:47.354005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:47.354005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:47.354005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:47.356318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 223/461] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:47.357442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05ea54-08ce-449f-ab04-c8fc25265649 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:47.385078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 239/462] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:47.386522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93ec1-0873-4a03-87dc-ae14ebd70e41 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:47.462563 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:47.480044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05ea54-08ce-449f-ab04-c8fc25265649 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:47.517593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ccb6e-ea37-41bb-b2d3-b6828a9d865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:47.519117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d93ec1-0873-4a03-87dc-ae14ebd70e41 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:47.519749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ccb6e-ea37-41bb-b2d3-b6828a9d865b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.520231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ccb6e-ea37-41bb-b2d3-b6828a9d865b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.520742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ccb6e-ea37-41bb-b2d3-b6828a9d865b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.532059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ccb6e-ea37-41bb-b2d3-b6828a9d865b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:47.535147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ccb6e-ea37-41bb-b2d3-b6828a9d865b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:47.555878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c184b24-41cd-4089-8041-854663c503cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:47.556580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184b24-41cd-4089-8041-854663c503cf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.556862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184b24-41cd-4089-8041-854663c503cf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.557135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184b24-41cd-4089-8041-854663c503cf None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.557860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c184b24-41cd-4089-8041-854663c503cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:47.558165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c184b24-41cd-4089-8041-854663c503cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:47.559578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c184b24-41cd-4089-8041-854663c503cf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d47ccb6e-ea37-41bb-b2d3-b6828a9d865b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:47.560844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:47.561674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:47.562602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:47.562602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:47.562602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:47.562602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:47.570342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 224/463] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:47.570342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ccb6e-ea37-41bb-b2d3-b6828a9d865b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:47.584546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 240/464] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:47.586046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c184b24-41cd-4089-8041-854663c503cf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:47.625190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:47.694653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ccb6e-ea37-41bb-b2d3-b6828a9d865b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:47.720524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c184b24-41cd-4089-8041-854663c503cf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:47.731550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e241a-7ca5-4704-8735-3c0698d43988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:47.732459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e241a-7ca5-4704-8735-3c0698d43988 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.732900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e241a-7ca5-4704-8735-3c0698d43988 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.733241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e241a-7ca5-4704-8735-3c0698d43988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.736545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:47.746350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e241a-7ca5-4704-8735-3c0698d43988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:47.748539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e241a-7ca5-4704-8735-3c0698d43988 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:47.766200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c294f8-fff8-4706-a5f3-91d0387003f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:47.766880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c294f8-fff8-4706-a5f3-91d0387003f0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.775123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c294f8-fff8-4706-a5f3-91d0387003f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.775123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c294f8-fff8-4706-a5f3-91d0387003f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.775123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c294f8-fff8-4706-a5f3-91d0387003f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:47.775123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c294f8-fff8-4706-a5f3-91d0387003f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f03e241a-7ca5-4704-8735-3c0698d43988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:47.775420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:47.776195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:47.777011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:47.777011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:47.777011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:47.777011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:47.777011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 225/465] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:47.777285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c294f8-fff8-4706-a5f3-91d0387003f0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:47.777349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e241a-7ca5-4704-8735-3c0698d43988 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:47.786519 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 241/466] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:47.787936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c294f8-fff8-4706-a5f3-91d0387003f0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:47.882112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e241a-7ca5-4704-8735-3c0698d43988 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:47.884656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:47.896442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c294f8-fff8-4706-a5f3-91d0387003f0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:47.921707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b880f-6367-4445-b613-7da1b575513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:47.922524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b880f-6367-4445-b613-7da1b575513e None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.923145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b880f-6367-4445-b613-7da1b575513e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.923429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b880f-6367-4445-b613-7da1b575513e None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.925422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b880f-6367-4445-b613-7da1b575513e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:47.927606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b880f-6367-4445-b613-7da1b575513e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:47.931030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef617b3-7705-4e21-99ac-0feccfcfd833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:47.931695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef617b3-7705-4e21-99ac-0feccfcfd833 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:47.931982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef617b3-7705-4e21-99ac-0feccfcfd833 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:47.932262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef617b3-7705-4e21-99ac-0feccfcfd833 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:47.932979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef617b3-7705-4e21-99ac-0feccfcfd833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:47.933286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef617b3-7705-4e21-99ac-0feccfcfd833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:47.934822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef617b3-7705-4e21-99ac-0feccfcfd833 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:47.947139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 242/467] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:47.947930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef617b3-7705-4e21-99ac-0feccfcfd833 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:48.041552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 226/468] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:47 2022] POST /identity/v3/users => generated 246 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:48.043729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733586fe-fd8f-4791-9fb2-82ba8fbf0644 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:48.050590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733586fe-fd8f-4791-9fb2-82ba8fbf0644 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:48.050590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733586fe-fd8f-4791-9fb2-82ba8fbf0644 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:48.050590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 227/469] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:48.050590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733586fe-fd8f-4791-9fb2-82ba8fbf0644 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:48.064485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef617b3-7705-4e21-99ac-0feccfcfd833 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:48.118135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3172e4-d28a-443f-a97c-96d9552c104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:48.118970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3172e4-d28a-443f-a97c-96d9552c104b None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:48.119576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3172e4-d28a-443f-a97c-96d9552c104b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:48.119866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3172e4-d28a-443f-a97c-96d9552c104b None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:48.120608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3172e4-d28a-443f-a97c-96d9552c104b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:48.122035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:48.123461 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3172e4-d28a-443f-a97c-96d9552c104b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:48.187878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733586fe-fd8f-4791-9fb2-82ba8fbf0644 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:48.191077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 243/470] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:47 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:48.192991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d26ca-8152-4392-8417-fb3de08cab7e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:48.193603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d26ca-8152-4392-8417-fb3de08cab7e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:48.194169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15d26ca-8152-4392-8417-fb3de08cab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:48.211830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:48.224014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f15d26ca-8152-4392-8417-fb3de08cab7e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:48.225591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f15d26ca-8152-4392-8417-fb3de08cab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:48.248083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4a555-c98f-4063-b912-578cf7d3270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:48.248317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4a555-c98f-4063-b912-578cf7d3270c None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:48.248535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4a555-c98f-4063-b912-578cf7d3270c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:48.248692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4a555-c98f-4063-b912-578cf7d3270c None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:48.249731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4a555-c98f-4063-b912-578cf7d3270c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:48.251808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4a555-c98f-4063-b912-578cf7d3270c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:48.318838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 244/471] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:48.331599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 228/472] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:48 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:48.344534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d26ca-8152-4392-8417-fb3de08cab7e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:48.470082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15d26ca-8152-4392-8417-fb3de08cab7e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:48.510035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6be53b-442f-45d2-a7fd-347c9844cb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:48.510854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be53b-442f-45d2-a7fd-347c9844cb02 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:48.511147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be53b-442f-45d2-a7fd-347c9844cb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:48.511424 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be53b-442f-45d2-a7fd-347c9844cb02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:48.513520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:48.523397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6be53b-442f-45d2-a7fd-347c9844cb02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:48.525434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6be53b-442f-45d2-a7fd-347c9844cb02 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2b6be53b-442f-45d2-a7fd-347c9844cb02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:48.545990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:48.547039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:48.548078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:48.548078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:48.548078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:48.548078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:48.549727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 245/473] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:48.555522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4a555-c98f-4063-b912-578cf7d3270c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:48.590445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093e2c7-bad4-4922-9a38-e93a6d325b0a None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:48.590445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093e2c7-bad4-4922-9a38-e93a6d325b0a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:48.590445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093e2c7-bad4-4922-9a38-e93a6d325b0a None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:48.591729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 246/474] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:27:48.597570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55061-e4f8-4ac1-a951-7fc4c7db0cd5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:48.597879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55061-e4f8-4ac1-a951-7fc4c7db0cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:48.598140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55061-e4f8-4ac1-a951-7fc4c7db0cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:48.624890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d5c55061-e4f8-4ac1-a951-7fc4c7db0cd5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:48.626426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d5c55061-e4f8-4ac1-a951-7fc4c7db0cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:48.713560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:48.718096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4a555-c98f-4063-b912-578cf7d3270c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:48.761332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 247/475] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:48.778430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6bbab-3e7b-46c6-91fb-2b61cf98d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:48.779140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6bbab-3e7b-46c6-91fb-2b61cf98d12c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:48.779431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6bbab-3e7b-46c6-91fb-2b61cf98d12c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:48.779712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6bbab-3e7b-46c6-91fb-2b61cf98d12c None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:48.780452 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6bbab-3e7b-46c6-91fb-2b61cf98d12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:48.780763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6bbab-3e7b-46c6-91fb-2b61cf98d12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:48.782178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6bbab-3e7b-46c6-91fb-2b61cf98d12c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:48.787808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c55061-e4f8-4ac1-a951-7fc4c7db0cd5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:48.811779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 229/476] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:48.816417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6bbab-3e7b-46c6-91fb-2b61cf98d12c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:48.970389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c55061-e4f8-4ac1-a951-7fc4c7db0cd5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:48.995659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6bbab-3e7b-46c6-91fb-2b61cf98d12c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:49.004886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:49.041055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:49.042139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:49.042628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:49.043126 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:49.044087 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:49.045657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:49.056801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8011362-592c-46c9-bc40-5aae167a84cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:49.057479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8011362-592c-46c9-bc40-5aae167a84cd None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:49.057767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8011362-592c-46c9-bc40-5aae167a84cd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:49.058056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8011362-592c-46c9-bc40-5aae167a84cd None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:49.058787 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8011362-592c-46c9-bc40-5aae167a84cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:49.060369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8011362-592c-46c9-bc40-5aae167a84cd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:49.093149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.sql.core [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 09:27:49.093149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 09:27:49.093149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [parameters: {'id': 'd1b2c531cf9a4b15923975cf3fe66a90', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 09:27:49.093149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80512) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application conn.query(q) Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result.read() Jun 24 09:27:49.111221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 09:27:49.112708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application next(self.gen) Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application yield resource Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application next(self.gen) Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise self.value Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application session.commit() Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 09:27:49.113619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.session.flush() Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application compat.raise_( Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 09:27:49.115093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 09:27:49.115965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application conn.query(q) Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result.read() Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 09:27:49.116814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [parameters: {'id': 'd1b2c531cf9a4b15923975cf3fe66a90', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:49.117574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 09:27:49.118353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:49.123085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 248/477] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 09:27:48 2022] POST /identity/v3/roles => generated 144 bytes in 326 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:27:49.123085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:49.156332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 230/478] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:48 2022] POST /identity/v3/users => generated 249 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:49.244468 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0c41a-8b0d-4d09-9c9c-1481ff7795cc None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:49.301002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d32afb-929f-44ea-af40-e79d12ba4326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:49.301873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32afb-929f-44ea-af40-e79d12ba4326 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:49.302157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32afb-929f-44ea-af40-e79d12ba4326 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:49.302433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d32afb-929f-44ea-af40-e79d12ba4326 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:49.317925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d32afb-929f-44ea-af40-e79d12ba4326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e9d32afb-929f-44ea-af40-e79d12ba4326 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:49.326362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:49.328534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 09:27:49.330524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:49.332006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 249/479] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:27:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:49.334377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8011362-592c-46c9-bc40-5aae167a84cd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:49.354395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:49.445846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8011362-592c-46c9-bc40-5aae167a84cd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:49.482455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0705cb6-8d67-457a-b5ba-716f963c9690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:49.483197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0705cb6-8d67-457a-b5ba-716f963c9690 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:49.483775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0705cb6-8d67-457a-b5ba-716f963c9690 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:49.484055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0705cb6-8d67-457a-b5ba-716f963c9690 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:49.484803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0705cb6-8d67-457a-b5ba-716f963c9690 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:49.485108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0705cb6-8d67-457a-b5ba-716f963c9690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:49.486481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0705cb6-8d67-457a-b5ba-716f963c9690 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:49.499602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 231/480] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:50.604094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6ef84-36cc-4dbb-9664-f0b719cb4416 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:50.604571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6ef84-36cc-4dbb-9664-f0b719cb4416 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:50.604672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6ef84-36cc-4dbb-9664-f0b719cb4416 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:50.606311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 250/481] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:50.613208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85ff2c-8ada-41a7-8474-3559d6536f55 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:50.613612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85ff2c-8ada-41a7-8474-3559d6536f55 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:50.613819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85ff2c-8ada-41a7-8474-3559d6536f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:50.638971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8e85ff2c-8ada-41a7-8474-3559d6536f55 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:50.640175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8e85ff2c-8ada-41a7-8474-3559d6536f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:50.737755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 232/482] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:50.777132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6ef84-36cc-4dbb-9664-f0b719cb4416 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:50.808996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf90e3-f1d7-4447-b64a-df2b3a9e0ded None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:50.809346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf90e3-f1d7-4447-b64a-df2b3a9e0ded None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:50.809551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf90e3-f1d7-4447-b64a-df2b3a9e0ded None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:50.811186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 233/483] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:50.816650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a82a3-d034-47c6-b33d-54c504bc6b30 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:50.816937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a82a3-d034-47c6-b33d-54c504bc6b30 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:50.817214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a82a3-d034-47c6-b33d-54c504bc6b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:50.834214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:50.845591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2a2a82a3-d034-47c6-b33d-54c504bc6b30 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:50.847465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2a2a82a3-d034-47c6-b33d-54c504bc6b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:50.849572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:50.899818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6ef84-36cc-4dbb-9664-f0b719cb4416 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:50.935159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 234/484] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:27:50.936554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539078be-6a9b-485d-9b03-1ae2381ca423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:50.936680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13ee22-777e-43fc-abe0-99dbbc3b2166 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:50.936856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13ee22-777e-43fc-abe0-99dbbc3b2166 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:50.937120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13ee22-777e-43fc-abe0-99dbbc3b2166 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:50.937565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539078be-6a9b-485d-9b03-1ae2381ca423 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:50.938051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539078be-6a9b-485d-9b03-1ae2381ca423 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:50.938504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539078be-6a9b-485d-9b03-1ae2381ca423 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:50.944401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 235/485] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:50.945554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189dcc-80d6-4672-9ce0-a6d11bdc9498 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:50.945843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189dcc-80d6-4672-9ce0-a6d11bdc9498 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:50.946125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc189dcc-80d6-4672-9ce0-a6d11bdc9498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:50.963934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539078be-6a9b-485d-9b03-1ae2381ca423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:50.970613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bc189dcc-80d6-4672-9ce0-a6d11bdc9498 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:50.972567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bc189dcc-80d6-4672-9ce0-a6d11bdc9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-539078be-6a9b-485d-9b03-1ae2381ca423 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:50.972965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:50.974946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 251/486] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:50.976904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539078be-6a9b-485d-9b03-1ae2381ca423 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.051487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 236/487] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:51.052454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189dcc-80d6-4672-9ce0-a6d11bdc9498 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.119243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:51.123530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539078be-6a9b-485d-9b03-1ae2381ca423 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.128158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:51.161840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e515-da8e-49c5-a062-867325909a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.162797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e515-da8e-49c5-a062-867325909a61 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.163180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e515-da8e-49c5-a062-867325909a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.163593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763e515-da8e-49c5-a062-867325909a61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.174829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763e515-da8e-49c5-a062-867325909a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:51.176920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc189dcc-80d6-4672-9ce0-a6d11bdc9498 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1763e515-da8e-49c5-a062-867325909a61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:51.183932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:51.184843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:51.185969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:51.190740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 252/488] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:51.191778 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e515-da8e-49c5-a062-867325909a61 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.223912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697549ab-8454-4f59-9033-1b27ca2aeae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.225124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697549ab-8454-4f59-9033-1b27ca2aeae1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.226015 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697549ab-8454-4f59-9033-1b27ca2aeae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.226730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697549ab-8454-4f59-9033-1b27ca2aeae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.227683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697549ab-8454-4f59-9033-1b27ca2aeae1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:51.228169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697549ab-8454-4f59-9033-1b27ca2aeae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:51.230901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697549ab-8454-4f59-9033-1b27ca2aeae1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:51.246658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 237/489] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:51.246658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697549ab-8454-4f59-9033-1b27ca2aeae1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.308505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763e515-da8e-49c5-a062-867325909a61 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.345457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7426c4-e1cb-4e09-b769-6eb200287415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.346572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7426c4-e1cb-4e09-b769-6eb200287415 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.347165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7426c4-e1cb-4e09-b769-6eb200287415 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.347684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7426c4-e1cb-4e09-b769-6eb200287415 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.347917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697549ab-8454-4f59-9033-1b27ca2aeae1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.359310 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7426c4-e1cb-4e09-b769-6eb200287415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1e7426c4-e1cb-4e09-b769-6eb200287415 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:51.368721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:51.369674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:51.370479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:51.372372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 253/490] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:51.373365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7426c4-e1cb-4e09-b769-6eb200287415 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.379676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:51.385001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefa627-eaea-4328-b044-cda9eed52b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.385732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefa627-eaea-4328-b044-cda9eed52b30 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.386189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefa627-eaea-4328-b044-cda9eed52b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.386307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefa627-eaea-4328-b044-cda9eed52b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.387063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefa627-eaea-4328-b044-cda9eed52b30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:51.387373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefa627-eaea-4328-b044-cda9eed52b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:51.388859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefa627-eaea-4328-b044-cda9eed52b30 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:51.398367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:51.403190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 238/491] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:51.404078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefa627-eaea-4328-b044-cda9eed52b30 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.481737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7426c4-e1cb-4e09-b769-6eb200287415 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.513424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefa627-eaea-4328-b044-cda9eed52b30 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.517384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6fb86-5a59-4c33-be42-de674f7165af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.518491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6fb86-5a59-4c33-be42-de674f7165af None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.519048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6fb86-5a59-4c33-be42-de674f7165af None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.519506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6fb86-5a59-4c33-be42-de674f7165af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.530902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6fb86-5a59-4c33-be42-de674f7165af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:51.532599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6fb86-5a59-4c33-be42-de674f7165af None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:51.551558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddeae-b42f-47da-8949-e8287668dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-01a6fb86-5a59-4c33-be42-de674f7165af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:51.551745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:51.552516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:51.553348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:51.553348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:51.553348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:51.553348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:51.553562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddeae-b42f-47da-8949-e8287668dae5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.553562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddeae-b42f-47da-8949-e8287668dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.553562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ddeae-b42f-47da-8949-e8287668dae5 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.553562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ddeae-b42f-47da-8949-e8287668dae5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:51.554298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ddeae-b42f-47da-8949-e8287668dae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:51.555268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672ddeae-b42f-47da-8949-e8287668dae5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:51.560526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 254/492] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:51.561592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6fb86-5a59-4c33-be42-de674f7165af None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.564278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 239/493] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:51.565760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddeae-b42f-47da-8949-e8287668dae5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.626754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:51.661392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:51.692576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ddeae-b42f-47da-8949-e8287668dae5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.702973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6fb86-5a59-4c33-be42-de674f7165af None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.743753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741861ee-770c-477e-a63c-0d92d07b61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.744813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741861ee-770c-477e-a63c-0d92d07b61a3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.745387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741861ee-770c-477e-a63c-0d92d07b61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.745864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741861ee-770c-477e-a63c-0d92d07b61a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.746790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741861ee-770c-477e-a63c-0d92d07b61a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:51.747263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20807b5-514c-4beb-8ccb-ddc3226b8c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.747558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741861ee-770c-477e-a63c-0d92d07b61a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:51.748069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20807b5-514c-4beb-8ccb-ddc3226b8c51 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.748358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20807b5-514c-4beb-8ccb-ddc3226b8c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.748725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20807b5-514c-4beb-8ccb-ddc3226b8c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.749765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741861ee-770c-477e-a63c-0d92d07b61a3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:51.761754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20807b5-514c-4beb-8ccb-ddc3226b8c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:51.763606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20807b5-514c-4beb-8ccb-ddc3226b8c51 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:51.770454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 240/494] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:51.771647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741861ee-770c-477e-a63c-0d92d07b61a3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-f20807b5-514c-4beb-8ccb-ddc3226b8c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:51.789702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:51.790616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:51.791485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:51.791485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:51.791485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:51.791485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:51.793883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 255/495] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:51.795000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20807b5-514c-4beb-8ccb-ddc3226b8c51 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.900857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741861ee-770c-477e-a63c-0d92d07b61a3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.917318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:51.929862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20807b5-514c-4beb-8ccb-ddc3226b8c51 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.939009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44cee-9ed4-4779-b14f-2093a1c74b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.939842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44cee-9ed4-4779-b14f-2093a1c74b90 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.940132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44cee-9ed4-4779-b14f-2093a1c74b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.940470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44cee-9ed4-4779-b14f-2093a1c74b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.953097 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd44cee-9ed4-4779-b14f-2093a1c74b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:51.954519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd44cee-9ed4-4779-b14f-2093a1c74b90 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:51.961212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:51.974694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93899d8-003b-4f7e-bbc5-8aba350d77f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-4bd44cee-9ed4-4779-b14f-2093a1c74b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:51.975296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:51.976137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:51.977392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:51.977392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:51.977392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:51.977392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:51.977392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 241/496] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:51.977392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44cee-9ed4-4779-b14f-2093a1c74b90 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.978577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93899d8-003b-4f7e-bbc5-8aba350d77f9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.979101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93899d8-003b-4f7e-bbc5-8aba350d77f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.979580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93899d8-003b-4f7e-bbc5-8aba350d77f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.991442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93899d8-003b-4f7e-bbc5-8aba350d77f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:51.993875 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93899d8-003b-4f7e-bbc5-8aba350d77f9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a93899d8-003b-4f7e-bbc5-8aba350d77f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:27:52.013265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:52.014248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:52.015604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 256/497] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:52.020408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93899d8-003b-4f7e-bbc5-8aba350d77f9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.098265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44cee-9ed4-4779-b14f-2093a1c74b90 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.130998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93899d8-003b-4f7e-bbc5-8aba350d77f9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.133896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded91d7-4c97-4ed4-b843-9d9f8bad2bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.134552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded91d7-4c97-4ed4-b843-9d9f8bad2bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.134834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded91d7-4c97-4ed4-b843-9d9f8bad2bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.135134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded91d7-4c97-4ed4-b843-9d9f8bad2bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.135847 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded91d7-4c97-4ed4-b843-9d9f8bad2bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:52.136157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded91d7-4c97-4ed4-b843-9d9f8bad2bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.137525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded91d7-4c97-4ed4-b843-9d9f8bad2bf2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.148414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 242/498] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:52.149218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded91d7-4c97-4ed4-b843-9d9f8bad2bf2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.164443 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083538a-9422-45a8-bb25-b1d034158c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.165043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083538a-9422-45a8-bb25-b1d034158c0f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.165330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083538a-9422-45a8-bb25-b1d034158c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.165607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083538a-9422-45a8-bb25-b1d034158c0f None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.166327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083538a-9422-45a8-bb25-b1d034158c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:52.166635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083538a-9422-45a8-bb25-b1d034158c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.168048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083538a-9422-45a8-bb25-b1d034158c0f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.175571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.179971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 257/499] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:52.181352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6c14-e606-4bf2-83bc-4b5fa0c2c16c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.181647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6c14-e606-4bf2-83bc-4b5fa0c2c16c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.181926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d6c14-e606-4bf2-83bc-4b5fa0c2c16c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.183191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 258/500] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:52.184519 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80bdc-fb3e-4f99-b273-67e1922c5cb6 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.184625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80bdc-fb3e-4f99-b273-67e1922c5cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.184898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab80bdc-fb3e-4f99-b273-67e1922c5cb6 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.188849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 259/501] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:52.188849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab80bdc-fb3e-4f99-b273-67e1922c5cb6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.234798 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.250654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded91d7-4c97-4ed4-b843-9d9f8bad2bf2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.285330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19340562-336b-4bee-9bb8-3f718e73a43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.285998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19340562-336b-4bee-9bb8-3f718e73a43f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.286290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19340562-336b-4bee-9bb8-3f718e73a43f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.286572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19340562-336b-4bee-9bb8-3f718e73a43f None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.287447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19340562-336b-4bee-9bb8-3f718e73a43f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:52.287759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19340562-336b-4bee-9bb8-3f718e73a43f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.289203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19340562-336b-4bee-9bb8-3f718e73a43f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.290758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab80bdc-fb3e-4f99-b273-67e1922c5cb6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.324696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88d73d-bee3-4068-9aff-d24121caf02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.325423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 243/502] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:52.325539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d73d-bee3-4068-9aff-d24121caf02e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.325742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d73d-bee3-4068-9aff-d24121caf02e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.326027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88d73d-bee3-4068-9aff-d24121caf02e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.327766 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19340562-336b-4bee-9bb8-3f718e73a43f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.333648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88d73d-bee3-4068-9aff-d24121caf02e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.335140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88d73d-bee3-4068-9aff-d24121caf02e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-6f88d73d-bee3-4068-9aff-d24121caf02e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:27:52.350032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:52.350974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:52.351936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 260/503] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:52.352481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f92bf1-b8d8-472f-b099-8ad6fbae2152 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.352719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f92bf1-b8d8-472f-b099-8ad6fbae2152 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.353007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f92bf1-b8d8-472f-b099-8ad6fbae2152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.369331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b3f92bf1-b8d8-472f-b099-8ad6fbae2152 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:52.370537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b3f92bf1-b8d8-472f-b099-8ad6fbae2152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:52.415500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.431405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19340562-336b-4bee-9bb8-3f718e73a43f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.437362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 261/504] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:52.438628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5abdb5-8273-451b-88c4-cf9feac4f279 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.438948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5abdb5-8273-451b-88c4-cf9feac4f279 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.439237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5abdb5-8273-451b-88c4-cf9feac4f279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.464914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0db949-c4f0-4531-ab18-8f6305c7a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.465716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0db949-c4f0-4531-ab18-8f6305c7a879 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.465998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0db949-c4f0-4531-ab18-8f6305c7a879 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.466273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0db949-c4f0-4531-ab18-8f6305c7a879 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.468202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0e5abdb5-8273-451b-88c4-cf9feac4f279 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:52.469385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0e5abdb5-8273-451b-88c4-cf9feac4f279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:52.474030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0db949-c4f0-4531-ab18-8f6305c7a879 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.475557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0db949-c4f0-4531-ab18-8f6305c7a879 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ff0db949-c4f0-4531-ab18-8f6305c7a879 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:27:52.492579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:52.493641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 244/505] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:52.494636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0db949-c4f0-4531-ab18-8f6305c7a879 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.500478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.539847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 262/506] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:52.540680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5abdb5-8273-451b-88c4-cf9feac4f279 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.601372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0db949-c4f0-4531-ab18-8f6305c7a879 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.636402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a52a5-869d-4266-9cda-c14b6d7fd2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.637046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a52a5-869d-4266-9cda-c14b6d7fd2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.637304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a52a5-869d-4266-9cda-c14b6d7fd2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.637576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a52a5-869d-4266-9cda-c14b6d7fd2a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.640977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5abdb5-8273-451b-88c4-cf9feac4f279 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.652489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.675379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dd2f-3d8f-4a8d-8163-9cf57f60d2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.675978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dd2f-3d8f-4a8d-8163-9cf57f60d2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.676263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dd2f-3d8f-4a8d-8163-9cf57f60d2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.676538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825dd2f-3d8f-4a8d-8163-9cf57f60d2f8 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.677365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825dd2f-3d8f-4a8d-8163-9cf57f60d2f8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:52.677671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825dd2f-3d8f-4a8d-8163-9cf57f60d2f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.679120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825dd2f-3d8f-4a8d-8163-9cf57f60d2f8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.706528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a52a5-869d-4266-9cda-c14b6d7fd2a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.708126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a52a5-869d-4266-9cda-c14b6d7fd2a6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.715237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 263/507] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:52.717082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dd2f-3d8f-4a8d-8163-9cf57f60d2f8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.740590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.812910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 245/508] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:52.813762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a52a5-869d-4266-9cda-c14b6d7fd2a6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.817563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825dd2f-3d8f-4a8d-8163-9cf57f60d2f8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.856222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffdd8b-c995-4801-a2d6-ca26bbf21da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.857318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffdd8b-c995-4801-a2d6-ca26bbf21da8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.857604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffdd8b-c995-4801-a2d6-ca26bbf21da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.857881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ffdd8b-c995-4801-a2d6-ca26bbf21da8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.859574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.868680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ffdd8b-c995-4801-a2d6-ca26bbf21da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-78ffdd8b-c995-4801-a2d6-ca26bbf21da8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:52.876379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:52.878138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 264/509] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:52.878970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffdd8b-c995-4801-a2d6-ca26bbf21da8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.915309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a52a5-869d-4266-9cda-c14b6d7fd2a6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.948897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6dfcb-108d-4e1f-a741-96c9d881e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.949495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6dfcb-108d-4e1f-a741-96c9d881e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.949782 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6dfcb-108d-4e1f-a741-96c9d881e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.950062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6dfcb-108d-4e1f-a741-96c9d881e9d3 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.950935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6dfcb-108d-4e1f-a741-96c9d881e9d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:52.951249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6dfcb-108d-4e1f-a741-96c9d881e9d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.952690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6dfcb-108d-4e1f-a741-96c9d881e9d3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.961129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.970246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 246/510] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:52.972233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6dfcb-108d-4e1f-a741-96c9d881e9d3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.984291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ffdd8b-c995-4801-a2d6-ca26bbf21da8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.019736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f7ed0-130e-43ae-a2e3-712fab83d1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.020514 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f7ed0-130e-43ae-a2e3-712fab83d1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.020921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f7ed0-130e-43ae-a2e3-712fab83d1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.021208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f7ed0-130e-43ae-a2e3-712fab83d1b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.031465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f7ed0-130e-43ae-a2e3-712fab83d1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.032928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f7ed0-130e-43ae-a2e3-712fab83d1b3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ad8f7ed0-130e-43ae-a2e3-712fab83d1b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:53.050013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:53.050885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:53.051731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:53.051731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:53.051731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:53.051731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:53.051731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 265/511] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:53.052005 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f7ed0-130e-43ae-a2e3-712fab83d1b3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.076817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6dfcb-108d-4e1f-a741-96c9d881e9d3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.078449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:53.112496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c99405-0e5a-4f14-b6fc-647c36773be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.113285 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c99405-0e5a-4f14-b6fc-647c36773be6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.113638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c99405-0e5a-4f14-b6fc-647c36773be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.113918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c99405-0e5a-4f14-b6fc-647c36773be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.154509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f7ed0-130e-43ae-a2e3-712fab83d1b3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.180452 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c99405-0e5a-4f14-b6fc-647c36773be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.181932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c99405-0e5a-4f14-b6fc-647c36773be6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.190828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002f0f7-f3dd-4497-9aa1-e0d9ef83738c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.191658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f0f7-f3dd-4497-9aa1-e0d9ef83738c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.191963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f0f7-f3dd-4497-9aa1-e0d9ef83738c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.192235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002f0f7-f3dd-4497-9aa1-e0d9ef83738c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.194127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:53.220671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002f0f7-f3dd-4497-9aa1-e0d9ef83738c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.220671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002f0f7-f3dd-4497-9aa1-e0d9ef83738c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2002f0f7-f3dd-4497-9aa1-e0d9ef83738c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:53.221950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:53.222968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:53.223964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:53.223964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:53.223964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:53.223964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:53.223964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 266/512] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:53.223964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002f0f7-f3dd-4497-9aa1-e0d9ef83738c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.285243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 247/513] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:53.286087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c99405-0e5a-4f14-b6fc-647c36773be6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.288389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:53.324866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002f0f7-f3dd-4497-9aa1-e0d9ef83738c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.357668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66646c09-e16b-4c33-be7d-f5e053f3270e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.358327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66646c09-e16b-4c33-be7d-f5e053f3270e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.358896 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66646c09-e16b-4c33-be7d-f5e053f3270e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.359181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66646c09-e16b-4c33-be7d-f5e053f3270e None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.359927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66646c09-e16b-4c33-be7d-f5e053f3270e None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:53.360235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66646c09-e16b-4c33-be7d-f5e053f3270e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.361624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66646c09-e16b-4c33-be7d-f5e053f3270e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.369882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 267/514] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:27:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:53.370664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66646c09-e16b-4c33-be7d-f5e053f3270e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.391482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c99405-0e5a-4f14-b6fc-647c36773be6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.418639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:53.425238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557373-7fe5-4fa0-9286-62aedf8c087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.425856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557373-7fe5-4fa0-9286-62aedf8c087b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.428761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557373-7fe5-4fa0-9286-62aedf8c087b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.428761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39557373-7fe5-4fa0-9286-62aedf8c087b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.469963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66646c09-e16b-4c33-be7d-f5e053f3270e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.492878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557373-7fe5-4fa0-9286-62aedf8c087b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.494320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39557373-7fe5-4fa0-9286-62aedf8c087b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.496137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:53.503643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed82b9-8397-4555-b3db-604a031c28e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.508858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed82b9-8397-4555-b3db-604a031c28e3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.508858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed82b9-8397-4555-b3db-604a031c28e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.508858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed82b9-8397-4555-b3db-604a031c28e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.508858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed82b9-8397-4555-b3db-604a031c28e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:53.508858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed82b9-8397-4555-b3db-604a031c28e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.508858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed82b9-8397-4555-b3db-604a031c28e3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.519123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 268/515] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:53.520079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed82b9-8397-4555-b3db-604a031c28e3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.602749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 248/516] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:53.603625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557373-7fe5-4fa0-9286-62aedf8c087b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.623438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed82b9-8397-4555-b3db-604a031c28e3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.634275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:53.658357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c153a2d-eef4-4809-b8e7-48cc87bbce2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.659067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c153a2d-eef4-4809-b8e7-48cc87bbce2f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.659445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c153a2d-eef4-4809-b8e7-48cc87bbce2f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.659733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c153a2d-eef4-4809-b8e7-48cc87bbce2f None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.660458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c153a2d-eef4-4809-b8e7-48cc87bbce2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:53.660769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c153a2d-eef4-4809-b8e7-48cc87bbce2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.662202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c153a2d-eef4-4809-b8e7-48cc87bbce2f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.674031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 269/517] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:53.675212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c153a2d-eef4-4809-b8e7-48cc87bbce2f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.704659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39557373-7fe5-4fa0-9286-62aedf8c087b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.706348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:53.740339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86cb04-eb3f-49d8-baf9-8a31d62ae1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.741128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86cb04-eb3f-49d8-baf9-8a31d62ae1df None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.741412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86cb04-eb3f-49d8-baf9-8a31d62ae1df None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.741686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86cb04-eb3f-49d8-baf9-8a31d62ae1df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.751732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86cb04-eb3f-49d8-baf9-8a31d62ae1df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.753147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86cb04-eb3f-49d8-baf9-8a31d62ae1df None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-7a86cb04-eb3f-49d8-baf9-8a31d62ae1df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:53.770571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:53.771765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:53.772612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:53.772612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:53.772612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:53.772612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:53.772612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 249/518] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:53.772612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86cb04-eb3f-49d8-baf9-8a31d62ae1df None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.783095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c153a2d-eef4-4809-b8e7-48cc87bbce2f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.817863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf200a10-f810-4370-83d9-e5cfa626c4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.818660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200a10-f810-4370-83d9-e5cfa626c4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.818979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200a10-f810-4370-83d9-e5cfa626c4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.819267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf200a10-f810-4370-83d9-e5cfa626c4b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.829677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf200a10-f810-4370-83d9-e5cfa626c4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.831332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf200a10-f810-4370-83d9-e5cfa626c4b7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-bf200a10-f810-4370-83d9-e5cfa626c4b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:53.849210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:53.850029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:53.850934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:53.850934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:53.850934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:53.850934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:53.850934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 270/519] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:53.851202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf200a10-f810-4370-83d9-e5cfa626c4b7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.873082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:53.877803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86cb04-eb3f-49d8-baf9-8a31d62ae1df None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.911637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cf586-f4f9-4d80-8211-e27cdf54e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.912305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cf586-f4f9-4d80-8211-e27cdf54e09e None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.912599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cf586-f4f9-4d80-8211-e27cdf54e09e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.912873 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cf586-f4f9-4d80-8211-e27cdf54e09e None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.913574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cf586-f4f9-4d80-8211-e27cdf54e09e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.915052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8cf586-f4f9-4d80-8211-e27cdf54e09e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.948897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf200a10-f810-4370-83d9-e5cfa626c4b7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.978340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 250/520] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:27:53 2022] POST /identity/v3/users => generated 247 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:53.979226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cf586-f4f9-4d80-8211-e27cdf54e09e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:53.985841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c68d-e75f-46bc-88dc-dbd0642ae425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.986794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c68d-e75f-46bc-88dc-dbd0642ae425 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.987654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c68d-e75f-46bc-88dc-dbd0642ae425 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.987901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c68d-e75f-46bc-88dc-dbd0642ae425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.994138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:54.007143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7c68d-e75f-46bc-88dc-dbd0642ae425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.007143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7c68d-e75f-46bc-88dc-dbd0642ae425 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-5ec7c68d-e75f-46bc-88dc-dbd0642ae425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:54.024779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:54.025854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:54.026714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:54.026714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:54.026714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:54.026714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:54.026714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 271/521] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:54.027487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c68d-e75f-46bc-88dc-dbd0642ae425 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.104018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8cf586-f4f9-4d80-8211-e27cdf54e09e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.113459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:54.142668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b37adc-f093-4985-8da7-126b3ddf6cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.144187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b37adc-f093-4985-8da7-126b3ddf6cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.144570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b37adc-f093-4985-8da7-126b3ddf6cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.144856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b37adc-f093-4985-8da7-126b3ddf6cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.147207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c68d-e75f-46bc-88dc-dbd0642ae425 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.152346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b37adc-f093-4985-8da7-126b3ddf6cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.153830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b37adc-f093-4985-8da7-126b3ddf6cf0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e8b37adc-f093-4985-8da7-126b3ddf6cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:27:54.170445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:54.171366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:54.172268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:27:54.172268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:27:54.172268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:27:54.172268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:27:54.172268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:27:54.172268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:27:54.172268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:54.172268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:54.172268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 251/522] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:54.173374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b37adc-f093-4985-8da7-126b3ddf6cf0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.192908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97d620-808b-4d2c-b9df-4b1fe25bff7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.193576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97d620-808b-4d2c-b9df-4b1fe25bff7b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.193861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97d620-808b-4d2c-b9df-4b1fe25bff7b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.194134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97d620-808b-4d2c-b9df-4b1fe25bff7b None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.194878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97d620-808b-4d2c-b9df-4b1fe25bff7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:54.195182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97d620-808b-4d2c-b9df-4b1fe25bff7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.196546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97d620-808b-4d2c-b9df-4b1fe25bff7b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.209714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 272/523] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:54.210547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97d620-808b-4d2c-b9df-4b1fe25bff7b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.252980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:54.285660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b37adc-f093-4985-8da7-126b3ddf6cf0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.314725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97d620-808b-4d2c-b9df-4b1fe25bff7b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.321002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14be2b-f3d3-4699-9877-2c76dd5757ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.321671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14be2b-f3d3-4699-9877-2c76dd5757ec None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.321959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14be2b-f3d3-4699-9877-2c76dd5757ec None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.322296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14be2b-f3d3-4699-9877-2c76dd5757ec None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.323062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14be2b-f3d3-4699-9877-2c76dd5757ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:54.323374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14be2b-f3d3-4699-9877-2c76dd5757ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.324778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14be2b-f3d3-4699-9877-2c76dd5757ec None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.341280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 252/524] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:54.341280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14be2b-f3d3-4699-9877-2c76dd5757ec None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.353624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:54.359110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b8755-92cf-4651-84ca-e4dc3cb43fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.359878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b8755-92cf-4651-84ca-e4dc3cb43fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.360174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b8755-92cf-4651-84ca-e4dc3cb43fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.360462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b8755-92cf-4651-84ca-e4dc3cb43fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.361212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b8755-92cf-4651-84ca-e4dc3cb43fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:54.361531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b8755-92cf-4651-84ca-e4dc3cb43fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.363136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b8755-92cf-4651-84ca-e4dc3cb43fa7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.375470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 273/525] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:54.376540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b8755-92cf-4651-84ca-e4dc3cb43fa7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.452874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14be2b-f3d3-4699-9877-2c76dd5757ec None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.485448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:54.488819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b8755-92cf-4651-84ca-e4dc3cb43fa7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.490976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14236f90-b5ac-4974-ba58-8deba01cb36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.491652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14236f90-b5ac-4974-ba58-8deba01cb36f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.491936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14236f90-b5ac-4974-ba58-8deba01cb36f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.492224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14236f90-b5ac-4974-ba58-8deba01cb36f None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.496531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14236f90-b5ac-4974-ba58-8deba01cb36f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:54.496531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14236f90-b5ac-4974-ba58-8deba01cb36f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.496531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14236f90-b5ac-4974-ba58-8deba01cb36f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.512989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 253/526] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:54.513842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14236f90-b5ac-4974-ba58-8deba01cb36f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.531818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607367d4-3b27-4a72-a819-03b1ba55f463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.532623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607367d4-3b27-4a72-a819-03b1ba55f463 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.532913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607367d4-3b27-4a72-a819-03b1ba55f463 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.533195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607367d4-3b27-4a72-a819-03b1ba55f463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.542249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607367d4-3b27-4a72-a819-03b1ba55f463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.543725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607367d4-3b27-4a72-a819-03b1ba55f463 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-607367d4-3b27-4a72-a819-03b1ba55f463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:27:54.559313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:54.560189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 274/527] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:54.566196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607367d4-3b27-4a72-a819-03b1ba55f463 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.632776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:54.639671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14236f90-b5ac-4974-ba58-8deba01cb36f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.681033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607367d4-3b27-4a72-a819-03b1ba55f463 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.682826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1648c-fceb-4ff5-ba00-7b07284cea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.683680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1648c-fceb-4ff5-ba00-7b07284cea63 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.683967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1648c-fceb-4ff5-ba00-7b07284cea63 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.684251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1648c-fceb-4ff5-ba00-7b07284cea63 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.692720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1648c-fceb-4ff5-ba00-7b07284cea63 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.694529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1648c-fceb-4ff5-ba00-7b07284cea63 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-53e1648c-fceb-4ff5-ba00-7b07284cea63 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:27:54.710248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:54.717414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 254/528] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:54.718529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1648c-fceb-4ff5-ba00-7b07284cea63 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.727260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b738ebb-f966-4d0e-a906-360c131f2da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.728090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b738ebb-f966-4d0e-a906-360c131f2da3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.728376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b738ebb-f966-4d0e-a906-360c131f2da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.728655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b738ebb-f966-4d0e-a906-360c131f2da3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.736531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b738ebb-f966-4d0e-a906-360c131f2da3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.738742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b738ebb-f966-4d0e-a906-360c131f2da3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2b738ebb-f966-4d0e-a906-360c131f2da3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:27:54.753728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:54.754647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 275/529] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:54.760615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b738ebb-f966-4d0e-a906-360c131f2da3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.781087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:54.842347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1648c-fceb-4ff5-ba00-7b07284cea63 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.872590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b738ebb-f966-4d0e-a906-360c131f2da3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:54.881315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d70a1-44a5-4199-b822-92907cfed8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.881972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d70a1-44a5-4199-b822-92907cfed8fc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.882253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d70a1-44a5-4199-b822-92907cfed8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.882528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6d70a1-44a5-4199-b822-92907cfed8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.883388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d70a1-44a5-4199-b822-92907cfed8fc None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=0422e6863c7147b79ea4d194e6e07154) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:54.883698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d70a1-44a5-4199-b822-92907cfed8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.885139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6d70a1-44a5-4199-b822-92907cfed8fc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.887361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:54.891650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 255/530] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/role_assignments?user.id=0422e6863c7147b79ea4d194e6e07154&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:54.892441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d70a1-44a5-4199-b822-92907cfed8fc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:54.920973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c65d75-8551-4cec-a893-6a8e95d522ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:54.922175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c65d75-8551-4cec-a893-6a8e95d522ae None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:54.922700 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c65d75-8551-4cec-a893-6a8e95d522ae None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:54.923221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c65d75-8551-4cec-a893-6a8e95d522ae None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:54.924522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c65d75-8551-4cec-a893-6a8e95d522ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:54.925088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c65d75-8551-4cec-a893-6a8e95d522ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:54.926776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c65d75-8551-4cec-a893-6a8e95d522ae None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:54.948251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 276/531] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:54.955003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c65d75-8551-4cec-a893-6a8e95d522ae None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:55.036033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6d70a1-44a5-4199-b822-92907cfed8fc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:55.052508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:55.075197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d33bcf-2726-4810-b949-176d6c653b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:55.075872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d33bcf-2726-4810-b949-176d6c653b74 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:55.076178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d33bcf-2726-4810-b949-176d6c653b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:55.076625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d33bcf-2726-4810-b949-176d6c653b74 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:55.077372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d33bcf-2726-4810-b949-176d6c653b74 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:55.077689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d33bcf-2726-4810-b949-176d6c653b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:55.080026 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d33bcf-2726-4810-b949-176d6c653b74 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:55.085372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c65d75-8551-4cec-a893-6a8e95d522ae None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:55.109758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 256/532] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:55.109758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d33bcf-2726-4810-b949-176d6c653b74 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:55.146147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1a09-7250-438f-96db-79caf91c8958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:55.147121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1a09-7250-438f-96db-79caf91c8958 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:55.147472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1a09-7250-438f-96db-79caf91c8958 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:55.147822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1a09-7250-438f-96db-79caf91c8958 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:55.148680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1a09-7250-438f-96db-79caf91c8958 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:55.149109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1a09-7250-438f-96db-79caf91c8958 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:55.151311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a1a09-7250-438f-96db-79caf91c8958 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:55.168543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 277/533] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:55.170196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1a09-7250-438f-96db-79caf91c8958 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:55.216176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:55.238733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d33bcf-2726-4810-b949-176d6c653b74 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:55.276376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd52ca7-183e-434f-a43d-ab8f58cb24fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:55.277349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd52ca7-183e-434f-a43d-ab8f58cb24fd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:55.277781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd52ca7-183e-434f-a43d-ab8f58cb24fd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:55.278208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd52ca7-183e-434f-a43d-ab8f58cb24fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:55.279216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd52ca7-183e-434f-a43d-ab8f58cb24fd None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=ee91a24eb66d4753bc6a81d278b1088f) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:55.279666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd52ca7-183e-434f-a43d-ab8f58cb24fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:55.281386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd52ca7-183e-434f-a43d-ab8f58cb24fd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:55.295020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 257/534] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:55 2022] GET /identity/v3/role_assignments?user.id=ee91a24eb66d4753bc6a81d278b1088f&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:55.296278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd52ca7-183e-434f-a43d-ab8f58cb24fd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:55.300230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1a09-7250-438f-96db-79caf91c8958 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:55.345063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:55.359696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3c782-65bf-41fa-bec7-9dad8a29f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:55.372874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3c782-65bf-41fa-bec7-9dad8a29f079 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:55.372874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3c782-65bf-41fa-bec7-9dad8a29f079 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:55.372874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3c782-65bf-41fa-bec7-9dad8a29f079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:55.463001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd52ca7-183e-434f-a43d-ab8f58cb24fd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:55.499142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3c782-65bf-41fa-bec7-9dad8a29f079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:55.501291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb3c782-65bf-41fa-bec7-9dad8a29f079 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:55.540038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:55.559276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d15b2f-c7c2-4cae-a351-3f52497f9f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:55.560326 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d15b2f-c7c2-4cae-a351-3f52497f9f15 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:55.560808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d15b2f-c7c2-4cae-a351-3f52497f9f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:55.561291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d15b2f-c7c2-4cae-a351-3f52497f9f15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:55.562808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d15b2f-c7c2-4cae-a351-3f52497f9f15 None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=d0a8a5a1bc174acd9b13477c7d4b4a07) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:55.563331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d15b2f-c7c2-4cae-a351-3f52497f9f15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:55.565924 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d15b2f-c7c2-4cae-a351-3f52497f9f15 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:55.586465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 258/535] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:55 2022] GET /identity/v3/role_assignments?user.id=d0a8a5a1bc174acd9b13477c7d4b4a07&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:55.654727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 278/536] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:55.660596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d15b2f-c7c2-4cae-a351-3f52497f9f15 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:55.795431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:55.799050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d15b2f-c7c2-4cae-a351-3f52497f9f15 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:55.839356 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5bcb5-d45c-479e-aaf6-213621f6bdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:55.840162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5bcb5-d45c-479e-aaf6-213621f6bdfe None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:55.840449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5bcb5-d45c-479e-aaf6-213621f6bdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:55.840726 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5bcb5-d45c-479e-aaf6-213621f6bdfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:55.852658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5bcb5-d45c-479e-aaf6-213621f6bdfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:55.854224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5bcb5-d45c-479e-aaf6-213621f6bdfe None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-87d5bcb5-d45c-479e-aaf6-213621f6bdfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:55.874462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:55.875405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:55.876927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:55.876927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:55.876927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:55.876927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:55.876927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 259/537] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:55.882083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3c782-65bf-41fa-bec7-9dad8a29f079 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:56.001838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3c782-65bf-41fa-bec7-9dad8a29f079 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:56.033273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:56.043230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9059e9-042b-464d-8afe-4eed680c505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:56.043916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9059e9-042b-464d-8afe-4eed680c505e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:56.044252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9059e9-042b-464d-8afe-4eed680c505e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:56.044530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9059e9-042b-464d-8afe-4eed680c505e None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:56.045346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9059e9-042b-464d-8afe-4eed680c505e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:56.045660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9059e9-042b-464d-8afe-4eed680c505e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:56.047087 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9059e9-042b-464d-8afe-4eed680c505e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:56.064342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 279/538] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:56.070057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5bcb5-d45c-479e-aaf6-213621f6bdfe None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:56.187618 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5bcb5-d45c-479e-aaf6-213621f6bdfe None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:56.230524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969f35-e59f-4ffe-a66f-9669bcac95f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:56.231380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969f35-e59f-4ffe-a66f-9669bcac95f2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:56.231668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969f35-e59f-4ffe-a66f-9669bcac95f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:56.231946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969f35-e59f-4ffe-a66f-9669bcac95f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:56.239125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb1dbf-09b8-4dfa-80a8-2593ac06637b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:56.239417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb1dbf-09b8-4dfa-80a8-2593ac06637b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:56.239702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb1dbf-09b8-4dfa-80a8-2593ac06637b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:56.240260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19969f35-e59f-4ffe-a66f-9669bcac95f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:56.241346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 280/539] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:56.241756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19969f35-e59f-4ffe-a66f-9669bcac95f2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:56.254467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33108-4100-4ce3-983f-275d0b7c2156 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:56.254744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33108-4100-4ce3-983f-275d0b7c2156 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:56.254956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd33108-4100-4ce3-983f-275d0b7c2156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-19969f35-e59f-4ffe-a66f-9669bcac95f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:27:56.262458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:56.264533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:56.266637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:27:56.266637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:27:56.266637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:27:56.266637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:27:56.266637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:27:56.266637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:27:56.266637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:56.266637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:56.266637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 260/540] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:56.271695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969f35-e59f-4ffe-a66f-9669bcac95f2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:56.289437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ecd33108-4100-4ce3-983f-275d0b7c2156 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:56.291026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ecd33108-4100-4ce3-983f-275d0b7c2156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:56.299438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:56.436771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 281/541] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:56.454769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969f35-e59f-4ffe-a66f-9669bcac95f2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:56.482386 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33108-4100-4ce3-983f-275d0b7c2156 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:56.508318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a8364-7e6c-4010-8280-f691ae6db2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:56.508911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a8364-7e6c-4010-8280-f691ae6db2dc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:56.509197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a8364-7e6c-4010-8280-f691ae6db2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:56.509472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a8364-7e6c-4010-8280-f691ae6db2dc None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:56.510268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a8364-7e6c-4010-8280-f691ae6db2dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:56.510583 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a8364-7e6c-4010-8280-f691ae6db2dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:56.515036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a8364-7e6c-4010-8280-f691ae6db2dc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:56.539583 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 261/542] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:56.549894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a8364-7e6c-4010-8280-f691ae6db2dc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:56.637463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd33108-4100-4ce3-983f-275d0b7c2156 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:56.683014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:56.688416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:56.714426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a8364-7e6c-4010-8280-f691ae6db2dc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:56.728452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80603e5c-27a2-4bc1-b5d9-24f3c73be252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:56.729272 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80603e5c-27a2-4bc1-b5d9-24f3c73be252 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:56.729559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80603e5c-27a2-4bc1-b5d9-24f3c73be252 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:56.729836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80603e5c-27a2-4bc1-b5d9-24f3c73be252 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:56.758808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d2a94-b9a9-4e38-b682-97ceddedf30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:56.759901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d2a94-b9a9-4e38-b682-97ceddedf30d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:56.760381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d2a94-b9a9-4e38-b682-97ceddedf30d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:56.760846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d2a94-b9a9-4e38-b682-97ceddedf30d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:56.761731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d2a94-b9a9-4e38-b682-97ceddedf30d None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=9b2db60c511f4fd29b772ca5fb014d03) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:56.762048 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d2a94-b9a9-4e38-b682-97ceddedf30d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:56.763532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d2a94-b9a9-4e38-b682-97ceddedf30d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:56.766562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80603e5c-27a2-4bc1-b5d9-24f3c73be252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-80603e5c-27a2-4bc1-b5d9-24f3c73be252 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:56.780105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:56.781021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:56.782238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 282/543] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:27:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:56.783164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 262/544] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:56 2022] GET /identity/v3/role_assignments?user.id=9b2db60c511f4fd29b772ca5fb014d03&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:56.787360 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80603e5c-27a2-4bc1-b5d9-24f3c73be252 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:56.959726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80603e5c-27a2-4bc1-b5d9-24f3c73be252 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:57.015781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec3d66-66b7-4c77-b167-fd4535234dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:57.016398 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec3d66-66b7-4c77-b167-fd4535234dad None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:57.016686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec3d66-66b7-4c77-b167-fd4535234dad None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:57.016966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec3d66-66b7-4c77-b167-fd4535234dad None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:57.017753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec3d66-66b7-4c77-b167-fd4535234dad None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:57.018703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec3d66-66b7-4c77-b167-fd4535234dad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:57.020333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec3d66-66b7-4c77-b167-fd4535234dad None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:57.029849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 283/545] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:27:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:57.035263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d2a94-b9a9-4e38-b682-97ceddedf30d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:57.186061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d2a94-b9a9-4e38-b682-97ceddedf30d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:57.236418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55376c-acee-4654-9c3f-e375e41aa7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:57.237906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55376c-acee-4654-9c3f-e375e41aa7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:57.238187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55376c-acee-4654-9c3f-e375e41aa7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:57.238463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55376c-acee-4654-9c3f-e375e41aa7c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:57.243902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:57.253230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55376c-acee-4654-9c3f-e375e41aa7c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:57.254702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55376c-acee-4654-9c3f-e375e41aa7c4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-8b55376c-acee-4654-9c3f-e375e41aa7c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:57.279093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:57.281174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:57.284635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:57.284635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:57.284635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:57.284635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:57.284635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 263/546] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:57.289134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec3d66-66b7-4c77-b167-fd4535234dad None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:57.342879 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f10e-ecb7-4181-97cc-0ea999758c2b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:57.343176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f10e-ecb7-4181-97cc-0ea999758c2b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:57.343423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487f10e-ecb7-4181-97cc-0ea999758c2b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:57.344801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 264/547] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:57.350876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba584c6c-255d-4668-a17f-3aa23e2820e4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:57.351254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba584c6c-255d-4668-a17f-3aa23e2820e4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:57.351837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba584c6c-255d-4668-a17f-3aa23e2820e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:57.383162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ba584c6c-255d-4668-a17f-3aa23e2820e4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:57.384773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:57.386337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ba584c6c-255d-4668-a17f-3aa23e2820e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:57.457922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec3d66-66b7-4c77-b167-fd4535234dad None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:57.493835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f196e-142b-403b-bc99-48285482dab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:57.494505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f196e-142b-403b-bc99-48285482dab9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:57.494793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f196e-142b-403b-bc99-48285482dab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:57.495109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f196e-142b-403b-bc99-48285482dab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:57.495835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f196e-142b-403b-bc99-48285482dab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:57.496148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f196e-142b-403b-bc99-48285482dab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:57.497756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f196e-142b-403b-bc99-48285482dab9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:57.510526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 284/548] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:57.518588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f196e-142b-403b-bc99-48285482dab9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:57.523230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 265/549] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:57.572330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba584c6c-255d-4668-a17f-3aa23e2820e4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:57.623234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f196e-142b-403b-bc99-48285482dab9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:57.625652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:57.660712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5ddc2-01cf-4d23-b606-f7007eea640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:57.661529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5ddc2-01cf-4d23-b606-f7007eea640e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:57.661818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5ddc2-01cf-4d23-b606-f7007eea640e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:57.662100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5ddc2-01cf-4d23-b606-f7007eea640e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:57.669832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5ddc2-01cf-4d23-b606-f7007eea640e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:57.671396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5ddc2-01cf-4d23-b606-f7007eea640e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-71c5ddc2-01cf-4d23-b606-f7007eea640e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:27:57.687274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:57.688230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:57.690431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 285/550] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:27:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:57.694533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5ddc2-01cf-4d23-b606-f7007eea640e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:57.786144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba584c6c-255d-4668-a17f-3aa23e2820e4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:57.807295 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5ddc2-01cf-4d23-b606-f7007eea640e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:57.821973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:57.847221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eba5b-aadb-41ef-86c9-97711505957b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:57.847221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eba5b-aadb-41ef-86c9-97711505957b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:57.847221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eba5b-aadb-41ef-86c9-97711505957b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:57.847221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965eba5b-aadb-41ef-86c9-97711505957b None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:57.847960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eba5b-aadb-41ef-86c9-97711505957b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:57.847960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eba5b-aadb-41ef-86c9-97711505957b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:57.848333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965eba5b-aadb-41ef-86c9-97711505957b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:57.860496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e99f3-6942-4129-b4f5-bc64858fd7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:57.861321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e99f3-6942-4129-b4f5-bc64858fd7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:57.861606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e99f3-6942-4129-b4f5-bc64858fd7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:57.862556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e99f3-6942-4129-b4f5-bc64858fd7b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:57.869459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 286/551] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 09:27:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:57.875923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eba5b-aadb-41ef-86c9-97711505957b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:57.878240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e99f3-6942-4129-b4f5-bc64858fd7b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a79e99f3-6942-4129-b4f5-bc64858fd7b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:57.886290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:57.888489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:57.890446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 266/552] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:27:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:57.898977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e99f3-6942-4129-b4f5-bc64858fd7b8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:57.943251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:57.986511 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965eba5b-aadb-41ef-86c9-97711505957b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:58.039903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b17b2-45df-42ef-a04d-6cf7130cab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:58.040566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b17b2-45df-42ef-a04d-6cf7130cab32 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.040849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b17b2-45df-42ef-a04d-6cf7130cab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.041121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b17b2-45df-42ef-a04d-6cf7130cab32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.072704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e99f3-6942-4129-b4f5-bc64858fd7b8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:58.111213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b17b2-45df-42ef-a04d-6cf7130cab32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:58.113279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b17b2-45df-42ef-a04d-6cf7130cab32 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:58.116914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3959-b9d6-470e-9c20-ba06b5f42058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:58.117774 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3959-b9d6-470e-9c20-ba06b5f42058 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.118204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3959-b9d6-470e-9c20-ba06b5f42058 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.118645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3959-b9d6-470e-9c20-ba06b5f42058 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.119600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b3959-b9d6-470e-9c20-ba06b5f42058 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:58.120091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b3959-b9d6-470e-9c20-ba06b5f42058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:58.122075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b3959-b9d6-470e-9c20-ba06b5f42058 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:58.133952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 267/553] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:27:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:27:58.135937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec3f1e-1b6b-4b8a-b53f-d6f0e2d95d3f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.136406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec3f1e-1b6b-4b8a-b53f-d6f0e2d95d3f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.136829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec3f1e-1b6b-4b8a-b53f-d6f0e2d95d3f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.138709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 268/554] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:58.139567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec3f1e-1b6b-4b8a-b53f-d6f0e2d95d3f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:58.143545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:58.191155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:58.224925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 287/555] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:27:58.226287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0e0a-7f71-4ae7-9ddb-f9ab590645b6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.226584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0e0a-7f71-4ae7-9ddb-f9ab590645b6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.226900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a0e0a-7f71-4ae7-9ddb-f9ab590645b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.244564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-399a0e0a-7f71-4ae7-9ddb-f9ab590645b6 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:58.245747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-399a0e0a-7f71-4ae7-9ddb-f9ab590645b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:58.256004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec3f1e-1b6b-4b8a-b53f-d6f0e2d95d3f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:58.292731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77985383-49a4-42b3-9858-58d3da013848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:58.293524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77985383-49a4-42b3-9858-58d3da013848 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.293811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77985383-49a4-42b3-9858-58d3da013848 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.294091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77985383-49a4-42b3-9858-58d3da013848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.305794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77985383-49a4-42b3-9858-58d3da013848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:58.307775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77985383-49a4-42b3-9858-58d3da013848 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:58.324463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 288/556] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:58.326130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033d62-f58f-42ab-93fb-4eadeefa96ef None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.326615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033d62-f58f-42ab-93fb-4eadeefa96ef None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.327156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44033d62-f58f-42ab-93fb-4eadeefa96ef None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-77985383-49a4-42b3-9858-58d3da013848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:58.328157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:58.328975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:58.329833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:58.329833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:58.329833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:58.329833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:58.336274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 269/557] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:58.336274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77985383-49a4-42b3-9858-58d3da013848 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:58.339325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 289/558] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:58.339325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44033d62-f58f-42ab-93fb-4eadeefa96ef None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:58.398000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:58.442634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:58.448098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44033d62-f58f-42ab-93fb-4eadeefa96ef None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:58.452116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77985383-49a4-42b3-9858-58d3da013848 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:58.484605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b92889-8f65-417e-a217-579a85dc9fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:58.485267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92889-8f65-417e-a217-579a85dc9fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.485545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92889-8f65-417e-a217-579a85dc9fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.485828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b92889-8f65-417e-a217-579a85dc9fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.486548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b92889-8f65-417e-a217-579a85dc9fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:58.486927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b92889-8f65-417e-a217-579a85dc9fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:58.488312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b92889-8f65-417e-a217-579a85dc9fa3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:58.491105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5966ea1-8a43-4de3-99f1-8de1aec7f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:58.491892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5966ea1-8a43-4de3-99f1-8de1aec7f5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.492175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5966ea1-8a43-4de3-99f1-8de1aec7f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.492447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5966ea1-8a43-4de3-99f1-8de1aec7f5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.504338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 290/559] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:58.504338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedcd4f-630d-48ba-b417-1ac03cd06e33 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.504338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedcd4f-630d-48ba-b417-1ac03cd06e33 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.504338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acedcd4f-630d-48ba-b417-1ac03cd06e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.508721 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5966ea1-8a43-4de3-99f1-8de1aec7f5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:58.510191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5966ea1-8a43-4de3-99f1-8de1aec7f5e5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:58.518663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-acedcd4f-630d-48ba-b417-1ac03cd06e33 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:58.519880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-acedcd4f-630d-48ba-b417-1ac03cd06e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a5966ea1-8a43-4de3-99f1-8de1aec7f5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:58.528883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:58.529761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:58.530690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:58.530690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:58.530690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:58.530690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:58.534867 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 270/560] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:58.535897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5966ea1-8a43-4de3-99f1-8de1aec7f5e5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:58.605131 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 291/561] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:58.606370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedcd4f-630d-48ba-b417-1ac03cd06e33 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:58.649580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5966ea1-8a43-4de3-99f1-8de1aec7f5e5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:58.666158 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:58.686157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f54fd-42a3-4909-bebb-ed3d94701046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:58.686927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f54fd-42a3-4909-bebb-ed3d94701046 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.687215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f54fd-42a3-4909-bebb-ed3d94701046 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.687493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f54fd-42a3-4909-bebb-ed3d94701046 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.699084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f54fd-42a3-4909-bebb-ed3d94701046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-6f2f54fd-42a3-4909-bebb-ed3d94701046 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:58.707785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:58.708907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:58.709792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 271/562] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:27:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:58.710470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f54fd-42a3-4909-bebb-ed3d94701046 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:58.718057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:58.735675 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acedcd4f-630d-48ba-b417-1ac03cd06e33 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:58.773326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc5875-d758-46ec-aab4-177df4dfe08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:58.774203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc5875-d758-46ec-aab4-177df4dfe08f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.774467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc5875-d758-46ec-aab4-177df4dfe08f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.774768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc5875-d758-46ec-aab4-177df4dfe08f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.782135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc5875-d758-46ec-aab4-177df4dfe08f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:58.784360 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc5875-d758-46ec-aab4-177df4dfe08f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-3bdc5875-d758-46ec-aab4-177df4dfe08f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:27:58.802086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:58.803464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:58.804392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 292/563] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 09:27:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:58.804989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc5875-d758-46ec-aab4-177df4dfe08f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:58.829556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f54fd-42a3-4909-bebb-ed3d94701046 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:58.866138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90189c-8c42-4bb2-906d-2210917e0a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:58.866926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90189c-8c42-4bb2-906d-2210917e0a4e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.867214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90189c-8c42-4bb2-906d-2210917e0a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.867499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90189c-8c42-4bb2-906d-2210917e0a4e None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.868221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90189c-8c42-4bb2-906d-2210917e0a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:58.868531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90189c-8c42-4bb2-906d-2210917e0a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:58.869907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90189c-8c42-4bb2-906d-2210917e0a4e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:58.887189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 272/564] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:58.887189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90189c-8c42-4bb2-906d-2210917e0a4e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:58.914198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc5875-d758-46ec-aab4-177df4dfe08f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:58.915680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:58.949694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb73ad-dd5f-49be-a104-a894774d8d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:58.950593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb73ad-dd5f-49be-a104-a894774d8d41 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:58.950905 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb73ad-dd5f-49be-a104-a894774d8d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:58.951181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb73ad-dd5f-49be-a104-a894774d8d41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:58.952686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:58.962359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb73ad-dd5f-49be-a104-a894774d8d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d2bb73ad-dd5f-49be-a104-a894774d8d41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:27:58.969963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:58.970928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:58.972430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 293/565] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:27:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:58.974077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb73ad-dd5f-49be-a104-a894774d8d41 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.001311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90189c-8c42-4bb2-906d-2210917e0a4e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.036499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed563c-72e5-4ba5-aac5-ae9a2149c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.037102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed563c-72e5-4ba5-aac5-ae9a2149c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.037390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed563c-72e5-4ba5-aac5-ae9a2149c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.037677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed563c-72e5-4ba5-aac5-ae9a2149c1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.038430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed563c-72e5-4ba5-aac5-ae9a2149c1c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:59.038741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed563c-72e5-4ba5-aac5-ae9a2149c1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.040154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed563c-72e5-4ba5-aac5-ae9a2149c1c7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.048233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 273/566] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:27:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:59.049018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed563c-72e5-4ba5-aac5-ae9a2149c1c7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.092325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb73ad-dd5f-49be-a104-a894774d8d41 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.129569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0a02-8f6d-4dbc-88ff-ec12fd0df0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.130335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0a02-8f6d-4dbc-88ff-ec12fd0df0aa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.130690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0a02-8f6d-4dbc-88ff-ec12fd0df0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.131009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e0a02-8f6d-4dbc-88ff-ec12fd0df0aa None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.131856 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e0a02-8f6d-4dbc-88ff-ec12fd0df0aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:59.132169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e0a02-8f6d-4dbc-88ff-ec12fd0df0aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.133594 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e0a02-8f6d-4dbc-88ff-ec12fd0df0aa None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.153509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed563c-72e5-4ba5-aac5-ae9a2149c1c7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.159712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 294/567] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 09:27:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:59.159712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0a02-8f6d-4dbc-88ff-ec12fd0df0aa None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.180347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:59.182633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:59.193615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139309-c43f-415e-9e6f-d534af8eba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.195370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139309-c43f-415e-9e6f-d534af8eba98 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.195668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139309-c43f-415e-9e6f-d534af8eba98 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.195952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea139309-c43f-415e-9e6f-d534af8eba98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.204217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea139309-c43f-415e-9e6f-d534af8eba98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.206647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea139309-c43f-415e-9e6f-d534af8eba98 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ea139309-c43f-415e-9e6f-d534af8eba98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:27:59.223557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:59.242228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 274/568] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:59.243374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139309-c43f-415e-9e6f-d534af8eba98 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.264234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e0a02-8f6d-4dbc-88ff-ec12fd0df0aa None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.298291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8a53-88bd-4d86-9c8c-5ac2f4fc0176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.299088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8a53-88bd-4d86-9c8c-5ac2f4fc0176 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.299985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8a53-88bd-4d86-9c8c-5ac2f4fc0176 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.300268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de8a53-88bd-4d86-9c8c-5ac2f4fc0176 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.301012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de8a53-88bd-4d86-9c8c-5ac2f4fc0176 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:59.301319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de8a53-88bd-4d86-9c8c-5ac2f4fc0176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.302695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de8a53-88bd-4d86-9c8c-5ac2f4fc0176 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.310481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 295/569] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:59.311285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8a53-88bd-4d86-9c8c-5ac2f4fc0176 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.327374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea139309-c43f-415e-9e6f-d534af8eba98 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.361267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658e5f4-7181-44f3-8bc4-709da3daa832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.362654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658e5f4-7181-44f3-8bc4-709da3daa832 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.362971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658e5f4-7181-44f3-8bc4-709da3daa832 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.363250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658e5f4-7181-44f3-8bc4-709da3daa832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.373174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658e5f4-7181-44f3-8bc4-709da3daa832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.374633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658e5f4-7181-44f3-8bc4-709da3daa832 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.391643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c658e5f4-7181-44f3-8bc4-709da3daa832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:59.391846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:59.392866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:59.394435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:59.394435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:59.394435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:59.394435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:27:59.394435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 275/570] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:59.394860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c7b4-0371-404e-82c4-7b08f144a204 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.395147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c7b4-0371-404e-82c4-7b08f144a204 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.395424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c7b4-0371-404e-82c4-7b08f144a204 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.396854 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 276/571] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:27:59.397376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c7b4-0371-404e-82c4-7b08f144a204 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.416844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de8a53-88bd-4d86-9c8c-5ac2f4fc0176 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.438478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:59.451011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7c4c-e1b4-4775-a5b1-13a6d6335287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.451806 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7c4c-e1b4-4775-a5b1-13a6d6335287 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.452969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7c4c-e1b4-4775-a5b1-13a6d6335287 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.452969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7c4c-e1b4-4775-a5b1-13a6d6335287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.464076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d7c4c-e1b4-4775-a5b1-13a6d6335287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.465567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d7c4c-e1b4-4775-a5b1-13a6d6335287 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-001d7c4c-e1b4-4775-a5b1-13a6d6335287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:59.483100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:59.484509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:59.485582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:59.485582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:59.485582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:59.485582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:59.485582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 296/572] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:59.485582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7c4c-e1b4-4775-a5b1-13a6d6335287 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.502142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c7b4-0371-404e-82c4-7b08f144a204 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.536518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f492-cf53-4485-88d3-afc5b8906a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.537176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f492-cf53-4485-88d3-afc5b8906a3c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.537460 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f492-cf53-4485-88d3-afc5b8906a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.537736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64f492-cf53-4485-88d3-afc5b8906a3c None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.538515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64f492-cf53-4485-88d3-afc5b8906a3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:59.538831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64f492-cf53-4485-88d3-afc5b8906a3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.540296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64f492-cf53-4485-88d3-afc5b8906a3c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.551592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 277/573] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:59.552381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f492-cf53-4485-88d3-afc5b8906a3c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.587466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7c4c-e1b4-4775-a5b1-13a6d6335287 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.624614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb74f3-7cd9-46b1-aa12-a343dc71f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.625417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb74f3-7cd9-46b1-aa12-a343dc71f741 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.625706 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb74f3-7cd9-46b1-aa12-a343dc71f741 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.625986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb74f3-7cd9-46b1-aa12-a343dc71f741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.627984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:59.636785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb74f3-7cd9-46b1-aa12-a343dc71f741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.640554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb74f3-7cd9-46b1-aa12-a343dc71f741 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.649624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:59.653948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64f492-cf53-4485-88d3-afc5b8906a3c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-23fb74f3-7cd9-46b1-aa12-a343dc71f741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:27:59.655521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:27:59.656451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:27:59.657584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:27:59.657584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:27:59.657584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:27:59.657584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:27:59.657584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 297/574] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:27:59.658035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf8b60-0460-4b8f-a393-485b25fb012c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.658174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf8b60-0460-4b8f-a393-485b25fb012c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.658455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf8b60-0460-4b8f-a393-485b25fb012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.675978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3ebf8b60-0460-4b8f-a393-485b25fb012c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:59.677163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3ebf8b60-0460-4b8f-a393-485b25fb012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:59.690056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f729ddd-2a25-407c-8422-ed542be14e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.690663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729ddd-2a25-407c-8422-ed542be14e0b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.690994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729ddd-2a25-407c-8422-ed542be14e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.691278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f729ddd-2a25-407c-8422-ed542be14e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.692066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f729ddd-2a25-407c-8422-ed542be14e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:59.693712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f729ddd-2a25-407c-8422-ed542be14e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.695137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f729ddd-2a25-407c-8422-ed542be14e0b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.706757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 278/575] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:59.707582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f729ddd-2a25-407c-8422-ed542be14e0b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.747457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 298/576] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:27:59.748294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf8b60-0460-4b8f-a393-485b25fb012c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.809962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f729ddd-2a25-407c-8422-ed542be14e0b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.843686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d434b49-9ef4-4ce5-87aa-22799b6560a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.844342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434b49-9ef4-4ce5-87aa-22799b6560a5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.844629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434b49-9ef4-4ce5-87aa-22799b6560a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.844906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d434b49-9ef4-4ce5-87aa-22799b6560a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.845622 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d434b49-9ef4-4ce5-87aa-22799b6560a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:59.845933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d434b49-9ef4-4ce5-87aa-22799b6560a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.847360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d434b49-9ef4-4ce5-87aa-22799b6560a5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.855086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf8b60-0460-4b8f-a393-485b25fb012c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:59.858633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 279/577] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:59.859701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d434b49-9ef4-4ce5-87aa-22799b6560a5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.872810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:59.878649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:59.891181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873776d-f459-4b0c-8e53-eb740421894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:59.891841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873776d-f459-4b0c-8e53-eb740421894d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:59.892137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873776d-f459-4b0c-8e53-eb740421894d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:59.892833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873776d-f459-4b0c-8e53-eb740421894d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:59.894658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873776d-f459-4b0c-8e53-eb740421894d None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=25606976e6fe4daf9a552368088cdef1) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:59.895286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873776d-f459-4b0c-8e53-eb740421894d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:59.896739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873776d-f459-4b0c-8e53-eb740421894d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:59.902093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 299/578] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/role_assignments?user.id=25606976e6fe4daf9a552368088cdef1&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:59.902885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873776d-f459-4b0c-8e53-eb740421894d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:59.965836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d434b49-9ef4-4ce5-87aa-22799b6560a5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.003645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaab1b-23ad-4bb5-bcfa-6f8566c00fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.004325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaab1b-23ad-4bb5-bcfa-6f8566c00fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.004608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaab1b-23ad-4bb5-bcfa-6f8566c00fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.004885 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfaab1b-23ad-4bb5-bcfa-6f8566c00fc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.005620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaab1b-23ad-4bb5-bcfa-6f8566c00fc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:00.005930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaab1b-23ad-4bb5-bcfa-6f8566c00fc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.007373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfaab1b-23ad-4bb5-bcfa-6f8566c00fc1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.020865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 280/579] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:00.021755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaab1b-23ad-4bb5-bcfa-6f8566c00fc1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.039734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873776d-f459-4b0c-8e53-eb740421894d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.077979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52432-2a02-4f97-a2e8-75d2718d00f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.078789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52432-2a02-4f97-a2e8-75d2718d00f0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.079100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52432-2a02-4f97-a2e8-75d2718d00f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.079375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52432-2a02-4f97-a2e8-75d2718d00f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.088162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a52432-2a02-4f97-a2e8-75d2718d00f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.089852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a52432-2a02-4f97-a2e8-75d2718d00f0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d3a52432-2a02-4f97-a2e8-75d2718d00f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:00.105553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:00.107280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 09:28:00.108241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:00.111181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 300/580] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:27:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:00.113300 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52432-2a02-4f97-a2e8-75d2718d00f0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.114028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:00.137265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfaab1b-23ad-4bb5-bcfa-6f8566c00fc1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.161806 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:00.177665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013273c7-f91d-45c4-96a1-86f13acf2832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.178476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013273c7-f91d-45c4-96a1-86f13acf2832 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.178764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013273c7-f91d-45c4-96a1-86f13acf2832 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.179071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013273c7-f91d-45c4-96a1-86f13acf2832 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.189909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013273c7-f91d-45c4-96a1-86f13acf2832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-013273c7-f91d-45c4-96a1-86f13acf2832 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:00.198288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:00.199290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:00.200130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 281/581] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:00.200897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013273c7-f91d-45c4-96a1-86f13acf2832 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.232481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52432-2a02-4f97-a2e8-75d2718d00f0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.270214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb2ab-320c-4658-b8a6-1aac85bb07d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.271145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb2ab-320c-4658-b8a6-1aac85bb07d1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.271445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb2ab-320c-4658-b8a6-1aac85bb07d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.271744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb2ab-320c-4658-b8a6-1aac85bb07d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.279119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabb2ab-320c-4658-b8a6-1aac85bb07d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.280457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabb2ab-320c-4658-b8a6-1aac85bb07d1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-5fabb2ab-320c-4658-b8a6-1aac85bb07d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:00.296808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:00.297747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:00.298615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:00.298615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:00.298615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:00.298615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:00.298615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:00.298615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:00.298615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:00.298615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:00.298615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 301/582] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:00.299133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb2ab-320c-4658-b8a6-1aac85bb07d1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.327820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013273c7-f91d-45c4-96a1-86f13acf2832 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.369890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07e711-2f22-4fee-bbcc-0815fe519996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.370793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07e711-2f22-4fee-bbcc-0815fe519996 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.371199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07e711-2f22-4fee-bbcc-0815fe519996 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.371547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07e711-2f22-4fee-bbcc-0815fe519996 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.380407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07e711-2f22-4fee-bbcc-0815fe519996 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.381886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07e711-2f22-4fee-bbcc-0815fe519996 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.383946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-7c07e711-2f22-4fee-bbcc-0815fe519996 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:00.399827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:00.400818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:00.401740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 282/583] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:00.402313 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07e711-2f22-4fee-bbcc-0815fe519996 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.412780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:00.416018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb2ab-320c-4658-b8a6-1aac85bb07d1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.457447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5014d-506d-4656-8e46-b3b0eb3d47e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.458602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5014d-506d-4656-8e46-b3b0eb3d47e3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.459099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5014d-506d-4656-8e46-b3b0eb3d47e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.459382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5014d-506d-4656-8e46-b3b0eb3d47e3 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.460333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5014d-506d-4656-8e46-b3b0eb3d47e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:00.460898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5014d-506d-4656-8e46-b3b0eb3d47e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.462926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5014d-506d-4656-8e46-b3b0eb3d47e3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.482466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 302/584] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:00.483218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5014d-506d-4656-8e46-b3b0eb3d47e3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.518611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07e711-2f22-4fee-bbcc-0815fe519996 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.556963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12335b3a-96ba-4e0d-b564-65c3171a5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.557647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12335b3a-96ba-4e0d-b564-65c3171a5c1d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.557927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12335b3a-96ba-4e0d-b564-65c3171a5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.558203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12335b3a-96ba-4e0d-b564-65c3171a5c1d None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.558989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12335b3a-96ba-4e0d-b564-65c3171a5c1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:00.559300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12335b3a-96ba-4e0d-b564-65c3171a5c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.560684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12335b3a-96ba-4e0d-b564-65c3171a5c1d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.574308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 283/585] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:00.574308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12335b3a-96ba-4e0d-b564-65c3171a5c1d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.601948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5014d-506d-4656-8e46-b3b0eb3d47e3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.642274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3948f-dab4-443c-9dab-43197011050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.643081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3948f-dab4-443c-9dab-43197011050d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.643368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3948f-dab4-443c-9dab-43197011050d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.643647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3948f-dab4-443c-9dab-43197011050d None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.644444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3948f-dab4-443c-9dab-43197011050d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:00.644756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3948f-dab4-443c-9dab-43197011050d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.646344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:00.647109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3948f-dab4-443c-9dab-43197011050d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.660970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 303/586] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:00.664190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3948f-dab4-443c-9dab-43197011050d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.689619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:00.698283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12335b3a-96ba-4e0d-b564-65c3171a5c1d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.737619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf3337-d853-4865-b0ef-afa959ebfa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.738152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf3337-d853-4865-b0ef-afa959ebfa60 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.738647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf3337-d853-4865-b0ef-afa959ebfa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.739216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf3337-d853-4865-b0ef-afa959ebfa60 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.740448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf3337-d853-4865-b0ef-afa959ebfa60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:00.740764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf3337-d853-4865-b0ef-afa959ebfa60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.742304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf3337-d853-4865-b0ef-afa959ebfa60 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.764680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 284/587] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:00.765514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf3337-d853-4865-b0ef-afa959ebfa60 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.786168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3948f-dab4-443c-9dab-43197011050d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.823538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06bc14-a723-4ac5-adee-cb7558f6633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.824485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06bc14-a723-4ac5-adee-cb7558f6633a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.824785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06bc14-a723-4ac5-adee-cb7558f6633a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.825050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06bc14-a723-4ac5-adee-cb7558f6633a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.837434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06bc14-a723-4ac5-adee-cb7558f6633a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.838906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06bc14-a723-4ac5-adee-cb7558f6633a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-5f06bc14-a723-4ac5-adee-cb7558f6633a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:00.858761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:00.859943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:00.860844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:00.860844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:00.860844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:00.860844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:00.860844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 304/588] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:00.862331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06bc14-a723-4ac5-adee-cb7558f6633a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.885303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf3337-d853-4865-b0ef-afa959ebfa60 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:00.906910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:00.927529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d51395-d898-4ae6-b3b6-36da81a67d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:00.928455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51395-d898-4ae6-b3b6-36da81a67d2b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:00.928740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51395-d898-4ae6-b3b6-36da81a67d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:00.929020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d51395-d898-4ae6-b3b6-36da81a67d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:00.939704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d51395-d898-4ae6-b3b6-36da81a67d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:00.940770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:00.942480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d51395-d898-4ae6-b3b6-36da81a67d2b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-40d51395-d898-4ae6-b3b6-36da81a67d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:00.963853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:00.964993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:00.966228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:00.966228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:00.966228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:00.966228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:00.966228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 285/589] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:00.967429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d51395-d898-4ae6-b3b6-36da81a67d2b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:00.980901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06bc14-a723-4ac5-adee-cb7558f6633a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.019319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6f74e-3e59-446a-97f0-f59f2e7a0275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.020144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6f74e-3e59-446a-97f0-f59f2e7a0275 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.020430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6f74e-3e59-446a-97f0-f59f2e7a0275 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.020736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6f74e-3e59-446a-97f0-f59f2e7a0275 None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/0422e6863c7147b79ea4d194e6e07154/roles/ea353bbe72d949cb9417cea310e8d194` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.037838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6f74e-3e59-446a-97f0-f59f2e7a0275 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=0422e6863c7147b79ea4d194e6e07154, role_id=ea353bbe72d949cb9417cea310e8d194)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.039348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6f74e-3e59-446a-97f0-f59f2e7a0275 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.083573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d51395-d898-4ae6-b3b6-36da81a67d2b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.126877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 305/590] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:00 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/0422e6863c7147b79ea4d194e6e07154/roles/ea353bbe72d949cb9417cea310e8d194 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:01.126877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6f74e-3e59-446a-97f0-f59f2e7a0275 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.134602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f129be-d536-47ce-9f3f-17331b8f02ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.135601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f129be-d536-47ce-9f3f-17331b8f02ef None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.135892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f129be-d536-47ce-9f3f-17331b8f02ef None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.136173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f129be-d536-47ce-9f3f-17331b8f02ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.148577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f129be-d536-47ce-9f3f-17331b8f02ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.150344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f129be-d536-47ce-9f3f-17331b8f02ef None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b9f129be-d536-47ce-9f3f-17331b8f02ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:01.172070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:01.173038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:01.173902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:01.173902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:01.173902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:01.173902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:01.173902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 286/591] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:01.174781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f129be-d536-47ce-9f3f-17331b8f02ef None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.202991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:01.264880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6f74e-3e59-446a-97f0-f59f2e7a0275 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.290482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f129be-d536-47ce-9f3f-17331b8f02ef None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.294971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:01.317786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19f49-5583-4018-9aca-a210efbe28ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.318567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19f49-5583-4018-9aca-a210efbe28ad None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.318945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19f49-5583-4018-9aca-a210efbe28ad None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.319293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b19f49-5583-4018-9aca-a210efbe28ad None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.320094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b19f49-5583-4018-9aca-a210efbe28ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:01.320471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b19f49-5583-4018-9aca-a210efbe28ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.322528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b19f49-5583-4018-9aca-a210efbe28ad None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.337001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 306/592] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:01.337469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19f49-5583-4018-9aca-a210efbe28ad None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.344996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790e57-c6ef-4b07-a7af-9d221fb93cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.345502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790e57-c6ef-4b07-a7af-9d221fb93cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.345785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790e57-c6ef-4b07-a7af-9d221fb93cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.346584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21790e57-c6ef-4b07-a7af-9d221fb93cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.348331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790e57-c6ef-4b07-a7af-9d221fb93cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:01.348470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790e57-c6ef-4b07-a7af-9d221fb93cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.349863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21790e57-c6ef-4b07-a7af-9d221fb93cf5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.363546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 287/593] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:01.364414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790e57-c6ef-4b07-a7af-9d221fb93cf5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.457197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b19f49-5583-4018-9aca-a210efbe28ad None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.460703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:01.480496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21790e57-c6ef-4b07-a7af-9d221fb93cf5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.497783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58afa7-19d6-45c9-b5d7-2f5b3debecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.498741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58afa7-19d6-45c9-b5d7-2f5b3debecd2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.499194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58afa7-19d6-45c9-b5d7-2f5b3debecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.499807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58afa7-19d6-45c9-b5d7-2f5b3debecd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.500671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58afa7-19d6-45c9-b5d7-2f5b3debecd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:01.501124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58afa7-19d6-45c9-b5d7-2f5b3debecd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.503307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58afa7-19d6-45c9-b5d7-2f5b3debecd2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.516353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 307/594] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:01.517493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58afa7-19d6-45c9-b5d7-2f5b3debecd2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.518615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a6c6d-9535-4974-ba7e-630e09068be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.519448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a6c6d-9535-4974-ba7e-630e09068be4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.519733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a6c6d-9535-4974-ba7e-630e09068be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.520011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a6c6d-9535-4974-ba7e-630e09068be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.527998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a6c6d-9535-4974-ba7e-630e09068be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.529526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a6c6d-9535-4974-ba7e-630e09068be4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-2d8a6c6d-9535-4974-ba7e-630e09068be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:01.545493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:01.546388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:01.547776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:01.547776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:01.547776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:01.547776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:01.547776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:01.547776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:01.547776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:01.547776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:01.550989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 288/595] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:01.552194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a6c6d-9535-4974-ba7e-630e09068be4 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.568274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:01.635186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58afa7-19d6-45c9-b5d7-2f5b3debecd2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.665709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a6c6d-9535-4974-ba7e-630e09068be4 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.672572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55cb9c-2ca8-44ee-909b-a7b302a1d2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.673753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55cb9c-2ca8-44ee-909b-a7b302a1d2bf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.674935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55cb9c-2ca8-44ee-909b-a7b302a1d2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.675533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55cb9c-2ca8-44ee-909b-a7b302a1d2bf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.684640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55cb9c-2ca8-44ee-909b-a7b302a1d2bf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.686494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55cb9c-2ca8-44ee-909b-a7b302a1d2bf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ba55cb9c-2ca8-44ee-909b-a7b302a1d2bf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:01.704637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:01.706152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 09:28:01.707105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:01.707622 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9353dc7-620a-486c-a48d-2b61bef10c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.708274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9353dc7-620a-486c-a48d-2b61bef10c21 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.708754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9353dc7-620a-486c-a48d-2b61bef10c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.709050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9353dc7-620a-486c-a48d-2b61bef10c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.710161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 308/596] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:01.711216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55cb9c-2ca8-44ee-909b-a7b302a1d2bf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.721972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9353dc7-620a-486c-a48d-2b61bef10c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.724154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9353dc7-620a-486c-a48d-2b61bef10c21 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f9353dc7-620a-486c-a48d-2b61bef10c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:01.740777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:01.741732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:01.742627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:01.742627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:01.742627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:01.742627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:01.742627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:01.742627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:01.742627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:01.742627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:01.742627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 289/597] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:01.743628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9353dc7-620a-486c-a48d-2b61bef10c21 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.750127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:01.826132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:01.829814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55cb9c-2ca8-44ee-909b-a7b302a1d2bf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.859661 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9353dc7-620a-486c-a48d-2b61bef10c21 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:01.867910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6fa6-2983-4700-be43-66beefe68dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.868972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6fa6-2983-4700-be43-66beefe68dec None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.869498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6fa6-2983-4700-be43-66beefe68dec None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.870105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6fa6-2983-4700-be43-66beefe68dec None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.871137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6fa6-2983-4700-be43-66beefe68dec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:01.871727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6fa6-2983-4700-be43-66beefe68dec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.873500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6fa6-2983-4700-be43-66beefe68dec None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.887678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 309/598] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:01.888915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6fa6-2983-4700-be43-66beefe68dec None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.897646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e3f38-5240-4ee8-bca1-a6cc9506de02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:01.898477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e3f38-5240-4ee8-bca1-a6cc9506de02 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:01.898765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e3f38-5240-4ee8-bca1-a6cc9506de02 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:01.899088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e3f38-5240-4ee8-bca1-a6cc9506de02 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:01.900624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e3f38-5240-4ee8-bca1-a6cc9506de02 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:01.900624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e3f38-5240-4ee8-bca1-a6cc9506de02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:01.902059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e3f38-5240-4ee8-bca1-a6cc9506de02 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:01.923282 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 290/599] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Jun 24 09:28:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:01.924158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e3f38-5240-4ee8-bca1-a6cc9506de02 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:01.993743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:02.006231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6fa6-2983-4700-be43-66beefe68dec None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:02.040562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e3f38-5240-4ee8-bca1-a6cc9506de02 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:02.044414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6521d-c9b2-4ce9-8c0e-fcb04f8ddf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:02.045500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6521d-c9b2-4ce9-8c0e-fcb04f8ddf72 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.045990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6521d-c9b2-4ce9-8c0e-fcb04f8ddf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.046465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6521d-c9b2-4ce9-8c0e-fcb04f8ddf72 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.047489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6521d-c9b2-4ce9-8c0e-fcb04f8ddf72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:02.048100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6521d-c9b2-4ce9-8c0e-fcb04f8ddf72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:02.049864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6521d-c9b2-4ce9-8c0e-fcb04f8ddf72 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:02.063286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 310/600] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:02.064408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6521d-c9b2-4ce9-8c0e-fcb04f8ddf72 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:02.079009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf92440-7168-47f1-ab33-f6b1a91eb6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:02.079816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf92440-7168-47f1-ab33-f6b1a91eb6eb None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.080099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf92440-7168-47f1-ab33-f6b1a91eb6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.080380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf92440-7168-47f1-ab33-f6b1a91eb6eb None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/ee91a24eb66d4753bc6a81d278b1088f/roles/ea353bbe72d949cb9417cea310e8d194` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.090782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:02.095847 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf92440-7168-47f1-ab33-f6b1a91eb6eb None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=ee91a24eb66d4753bc6a81d278b1088f, role_id=ea353bbe72d949cb9417cea310e8d194)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:02.097490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf92440-7168-47f1-ab33-f6b1a91eb6eb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:02.151908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 291/601] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:01 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/ee91a24eb66d4753bc6a81d278b1088f/roles/ea353bbe72d949cb9417cea310e8d194 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:02.151908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319c2b-8f18-45c7-9349-4b0c71e27d52 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.151908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319c2b-8f18-45c7-9349-4b0c71e27d52 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.151908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319c2b-8f18-45c7-9349-4b0c71e27d52 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.151908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 292/602] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:02.151908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319c2b-8f18-45c7-9349-4b0c71e27d52 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:02.185512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6521d-c9b2-4ce9-8c0e-fcb04f8ddf72 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:02.232394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b17cb-7e27-4f21-81c3-28cbffd23189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:02.233414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b17cb-7e27-4f21-81c3-28cbffd23189 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.233760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b17cb-7e27-4f21-81c3-28cbffd23189 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.234290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b17cb-7e27-4f21-81c3-28cbffd23189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.247139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b17cb-7e27-4f21-81c3-28cbffd23189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:02.248680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b17cb-7e27-4f21-81c3-28cbffd23189 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-725b17cb-7e27-4f21-81c3-28cbffd23189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:02.269364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:02.270318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:02.271693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:02.271693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:02.271693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:02.271693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:02.271693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 311/603] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:02.274867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae81cfa-6e47-4a32-91f9-6428f4fbcdda None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.274867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae81cfa-6e47-4a32-91f9-6428f4fbcdda None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.274867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae81cfa-6e47-4a32-91f9-6428f4fbcdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.283963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319c2b-8f18-45c7-9349-4b0c71e27d52 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:02.292199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2ae81cfa-6e47-4a32-91f9-6428f4fbcdda None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:02.293472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2ae81cfa-6e47-4a32-91f9-6428f4fbcdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:02.298346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:02.332724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e071199-770a-4237-a168-f7c5045dc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:02.333590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e071199-770a-4237-a168-f7c5045dc22c None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.334752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e071199-770a-4237-a168-f7c5045dc22c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.334752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e071199-770a-4237-a168-f7c5045dc22c None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/d0a8a5a1bc174acd9b13477c7d4b4a07/roles/ea353bbe72d949cb9417cea310e8d194` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.359805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e071199-770a-4237-a168-f7c5045dc22c None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=d0a8a5a1bc174acd9b13477c7d4b4a07, role_id=ea353bbe72d949cb9417cea310e8d194)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:02.361272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e071199-770a-4237-a168-f7c5045dc22c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:02.380869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 312/604] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:02.382183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae81cfa-6e47-4a32-91f9-6428f4fbcdda None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:02.384948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:02.447817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 293/605] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:02 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/d0a8a5a1bc174acd9b13477c7d4b4a07/roles/ea353bbe72d949cb9417cea310e8d194 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:02.448672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e071199-770a-4237-a168-f7c5045dc22c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:02.514803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae81cfa-6e47-4a32-91f9-6428f4fbcdda None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:02.559841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de185f4-7178-48a7-83a1-1bce1c017c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:02.561115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de185f4-7178-48a7-83a1-1bce1c017c98 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.561631 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de185f4-7178-48a7-83a1-1bce1c017c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.562581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de185f4-7178-48a7-83a1-1bce1c017c98 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.563750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de185f4-7178-48a7-83a1-1bce1c017c98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:02.564302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de185f4-7178-48a7-83a1-1bce1c017c98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:02.566548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de185f4-7178-48a7-83a1-1bce1c017c98 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:02.582311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 313/606] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:02.588193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de185f4-7178-48a7-83a1-1bce1c017c98 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:02.657044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e071199-770a-4237-a168-f7c5045dc22c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:02.667204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:02.713766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de185f4-7178-48a7-83a1-1bce1c017c98 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:02.745938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d7176-8e62-4016-bf6e-590b97b82cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:02.746793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d7176-8e62-4016-bf6e-590b97b82cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.747115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d7176-8e62-4016-bf6e-590b97b82cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.747376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d7176-8e62-4016-bf6e-590b97b82cc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.756656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de5047-623b-4e71-9c09-a22da9643ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:02.757729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5047-623b-4e71-9c09-a22da9643ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.758023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5047-623b-4e71-9c09-a22da9643ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.758695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de5047-623b-4e71-9c09-a22da9643ce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.762679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d7176-8e62-4016-bf6e-590b97b82cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:02.766224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de5047-623b-4e71-9c09-a22da9643ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:02.767777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de5047-623b-4e71-9c09-a22da9643ce6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-466d7176-8e62-4016-bf6e-590b97b82cc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:02.771499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:02.777565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:02.778381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 294/607] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:02.782887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d7176-8e62-4016-bf6e-590b97b82cc7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d3de5047-623b-4e71-9c09-a22da9643ce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:02.789068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:02.789943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:02.790818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:02.790818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:02.790818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:02.790818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:02.790818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:02.790818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:02.790818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:02.790818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:02.794864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 314/608] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:02.798031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de5047-623b-4e71-9c09-a22da9643ce6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:02.806211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:02.926391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d7176-8e62-4016-bf6e-590b97b82cc7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:02.964661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de5047-623b-4e71-9c09-a22da9643ce6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:02.973159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce6af5-c531-4a31-b0bc-c40da8122e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:02.973855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce6af5-c531-4a31-b0bc-c40da8122e40 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:02.974143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce6af5-c531-4a31-b0bc-c40da8122e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:02.974422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce6af5-c531-4a31-b0bc-c40da8122e40 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:02.975215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce6af5-c531-4a31-b0bc-c40da8122e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:02.975529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce6af5-c531-4a31-b0bc-c40da8122e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:02.976982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce6af5-c531-4a31-b0bc-c40da8122e40 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:02.999369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:02.999557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 295/609] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:03.003955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce6af5-c531-4a31-b0bc-c40da8122e40 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:03.016664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946cd8-e70e-45cb-980e-099039788121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:03.017350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946cd8-e70e-45cb-980e-099039788121 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.017640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946cd8-e70e-45cb-980e-099039788121 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.017924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea946cd8-e70e-45cb-980e-099039788121 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.019671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea946cd8-e70e-45cb-980e-099039788121 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:03.019993 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea946cd8-e70e-45cb-980e-099039788121 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:03.021469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea946cd8-e70e-45cb-980e-099039788121 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:03.047191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 315/610] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:03.053036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946cd8-e70e-45cb-980e-099039788121 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:03.160830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:03.184450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce6af5-c531-4a31-b0bc-c40da8122e40 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:03.191550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea946cd8-e70e-45cb-980e-099039788121 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:03.241238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564befd-5f46-463b-853a-5c848f85f3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:03.242048 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564befd-5f46-463b-853a-5c848f85f3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.242329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564befd-5f46-463b-853a-5c848f85f3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.242603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564befd-5f46-463b-853a-5c848f85f3b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.253791 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188ca01-3f6b-47f2-9531-f1d536c876ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:03.254526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188ca01-3f6b-47f2-9531-f1d536c876ca None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.254814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188ca01-3f6b-47f2-9531-f1d536c876ca None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.255124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188ca01-3f6b-47f2-9531-f1d536c876ca None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/9b2db60c511f4fd29b772ca5fb014d03/roles/ea353bbe72d949cb9417cea310e8d194` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.268000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564befd-5f46-463b-853a-5c848f85f3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:03.270378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a564befd-5f46-463b-853a-5c848f85f3b2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:03.274864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188ca01-3f6b-47f2-9531-f1d536c876ca None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=9b2db60c511f4fd29b772ca5fb014d03, role_id=ea353bbe72d949cb9417cea310e8d194)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:03.274864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188ca01-3f6b-47f2-9531-f1d536c876ca None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a564befd-5f46-463b-853a-5c848f85f3b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:03.293951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:03.295196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:03.296076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:03.296076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:03.296076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:03.296076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:03.296076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 296/611] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:03.301441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564befd-5f46-463b-853a-5c848f85f3b2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:03.355865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 316/612] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:03 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/9b2db60c511f4fd29b772ca5fb014d03/roles/ea353bbe72d949cb9417cea310e8d194 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:03.421589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564befd-5f46-463b-853a-5c848f85f3b2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:03.472595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1edde76-d91a-430a-8e20-b4d8554dd149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:03.472907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edde76-d91a-430a-8e20-b4d8554dd149 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.473081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edde76-d91a-430a-8e20-b4d8554dd149 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.473311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1edde76-d91a-430a-8e20-b4d8554dd149 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.474050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edde76-d91a-430a-8e20-b4d8554dd149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:03.474359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edde76-d91a-430a-8e20-b4d8554dd149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:03.476430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1edde76-d91a-430a-8e20-b4d8554dd149 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:03.479217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:03.501053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 297/613] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:03.507023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188ca01-3f6b-47f2-9531-f1d536c876ca None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:03.548198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7fad5-f8dc-41dd-9e3e-5ad759717eb7 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.548198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7fad5-f8dc-41dd-9e3e-5ad759717eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.548198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7fad5-f8dc-41dd-9e3e-5ad759717eb7 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.550133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 298/614] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:03.555710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efd73-b8b2-43e5-89cb-6788af374ac7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.555995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efd73-b8b2-43e5-89cb-6788af374ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.556277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efd73-b8b2-43e5-89cb-6788af374ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.571595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:03.576995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-552efd73-b8b2-43e5-89cb-6788af374ac7 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:03.578202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-552efd73-b8b2-43e5-89cb-6788af374ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:03.689346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 299/615] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:28:03.692878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188ca01-3f6b-47f2-9531-f1d536c876ca None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:03.730740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4479c86-e685-4eb1-bd6b-f86dc33a5fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:03.731941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4479c86-e685-4eb1-bd6b-f86dc33a5fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.732425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4479c86-e685-4eb1-bd6b-f86dc33a5fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.732914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4479c86-e685-4eb1-bd6b-f86dc33a5fa6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.736648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552efd73-b8b2-43e5-89cb-6788af374ac7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:03.752282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4479c86-e685-4eb1-bd6b-f86dc33a5fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:03.755834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4479c86-e685-4eb1-bd6b-f86dc33a5fa6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-f4479c86-e685-4eb1-bd6b-f86dc33a5fa6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:03.779195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:03.780140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:03.781055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:03.790696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 317/616] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:03.796549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4479c86-e685-4eb1-bd6b-f86dc33a5fa6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:03.921491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552efd73-b8b2-43e5-89cb-6788af374ac7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:03.960759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:03.971347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:03.971942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4479c86-e685-4eb1-bd6b-f86dc33a5fa6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:03.991429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d250b7e-4871-4d2c-a5b7-74a7a8d01a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:03.992557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d250b7e-4871-4d2c-a5b7-74a7a8d01a6a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.993052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d250b7e-4871-4d2c-a5b7-74a7a8d01a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.993522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d250b7e-4871-4d2c-a5b7-74a7a8d01a6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.013558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d250b7e-4871-4d2c-a5b7-74a7a8d01a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-0d250b7e-4871-4d2c-a5b7-74a7a8d01a6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:04.025860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:04.026856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:04.027974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:04.034570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 300/617] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:04.042122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d250b7e-4871-4d2c-a5b7-74a7a8d01a6a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:04.059144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87935419-6534-42df-a5a7-d76d0cfe3efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:04.059826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87935419-6534-42df-a5a7-d76d0cfe3efb None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.060117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87935419-6534-42df-a5a7-d76d0cfe3efb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.060396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87935419-6534-42df-a5a7-d76d0cfe3efb None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.061249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87935419-6534-42df-a5a7-d76d0cfe3efb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:04.061563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87935419-6534-42df-a5a7-d76d0cfe3efb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:04.063035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87935419-6534-42df-a5a7-d76d0cfe3efb None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:04.101832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 318/618] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 09:28:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:04.107855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87935419-6534-42df-a5a7-d76d0cfe3efb None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:04.222338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d250b7e-4871-4d2c-a5b7-74a7a8d01a6a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:04.279979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4b998-b3fe-4189-853e-2070f6c4a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:04.280577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4b998-b3fe-4189-853e-2070f6c4a442 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.280862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4b998-b3fe-4189-853e-2070f6c4a442 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.281140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4b998-b3fe-4189-853e-2070f6c4a442 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.281907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4b998-b3fe-4189-853e-2070f6c4a442 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:04.282219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4b998-b3fe-4189-853e-2070f6c4a442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:04.284158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4b998-b3fe-4189-853e-2070f6c4a442 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:04.305149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 301/619] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:04.308060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4b998-b3fe-4189-853e-2070f6c4a442 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:04.325332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87935419-6534-42df-a5a7-d76d0cfe3efb None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:04.397511 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0517a-b1a6-4604-ab20-99d9e5203d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:04.398329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0517a-b1a6-4604-ab20-99d9e5203d51 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.398617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0517a-b1a6-4604-ab20-99d9e5203d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.398951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0517a-b1a6-4604-ab20-99d9e5203d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.399176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:04.418388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0517a-b1a6-4604-ab20-99d9e5203d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:04.420908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0517a-b1a6-4604-ab20-99d9e5203d51 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-52e0517a-b1a6-4604-ab20-99d9e5203d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:04.455964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:04.457035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:04.457915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:04.457915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:04.457915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:04.457915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:04.457915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 319/620] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:04.464075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0517a-b1a6-4604-ab20-99d9e5203d51 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:04.475167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:04.491260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4b998-b3fe-4189-853e-2070f6c4a442 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:04.526500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad256e8-065f-4d63-9427-24b140602aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:04.527371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad256e8-065f-4d63-9427-24b140602aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.527662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad256e8-065f-4d63-9427-24b140602aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.527942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad256e8-065f-4d63-9427-24b140602aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.539719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad256e8-065f-4d63-9427-24b140602aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:04.541255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad256e8-065f-4d63-9427-24b140602aa7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3ad256e8-065f-4d63-9427-24b140602aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:04.559697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:04.560630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:04.561526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:04.561526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:04.561526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:04.561526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:04.565528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 302/621] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:04.570875 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad256e8-065f-4d63-9427-24b140602aa7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:04.678534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad256e8-065f-4d63-9427-24b140602aa7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:04.682472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:04.695941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0517a-b1a6-4604-ab20-99d9e5203d51 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:04.708859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1878e8c-89e6-4c3e-97f0-c0e18c58277f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:04.709546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878e8c-89e6-4c3e-97f0-c0e18c58277f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.709833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878e8c-89e6-4c3e-97f0-c0e18c58277f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.710197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878e8c-89e6-4c3e-97f0-c0e18c58277f None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.710931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1878e8c-89e6-4c3e-97f0-c0e18c58277f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:04.711249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1878e8c-89e6-4c3e-97f0-c0e18c58277f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:04.712804 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1878e8c-89e6-4c3e-97f0-c0e18c58277f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:04.731495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 303/622] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:04.733165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3794c-abe3-4e3c-892f-7fe8d3eef6da None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.733465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3794c-abe3-4e3c-892f-7fe8d3eef6da None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.733751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3794c-abe3-4e3c-892f-7fe8d3eef6da None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.740115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 304/623] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:04.740115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3794c-abe3-4e3c-892f-7fe8d3eef6da None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:04.743364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af22a6-153b-452b-bfc9-a0b93cf66c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:04.744251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af22a6-153b-452b-bfc9-a0b93cf66c41 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.744737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af22a6-153b-452b-bfc9-a0b93cf66c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.745187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af22a6-153b-452b-bfc9-a0b93cf66c41 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.746127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af22a6-153b-452b-bfc9-a0b93cf66c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:04.746637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af22a6-153b-452b-bfc9-a0b93cf66c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:04.748305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af22a6-153b-452b-bfc9-a0b93cf66c41 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:04.761802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 320/624] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:04.763379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ad424-a945-4026-84a5-e83ee5253945 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.763870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ad424-a945-4026-84a5-e83ee5253945 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.764322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ad424-a945-4026-84a5-e83ee5253945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.784609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-632ad424-a945-4026-84a5-e83ee5253945 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:04.786160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-632ad424-a945-4026-84a5-e83ee5253945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:04.848711 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:04.857205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3794c-abe3-4e3c-892f-7fe8d3eef6da None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:04.866874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 321/625] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:04.866874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ad424-a945-4026-84a5-e83ee5253945 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:04.893686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352b8aa-8286-4fbc-9efa-06b96b5c1c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:04.894480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352b8aa-8286-4fbc-9efa-06b96b5c1c8f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.894763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352b8aa-8286-4fbc-9efa-06b96b5c1c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.895078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352b8aa-8286-4fbc-9efa-06b96b5c1c8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.903010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352b8aa-8286-4fbc-9efa-06b96b5c1c8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:04.904460 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352b8aa-8286-4fbc-9efa-06b96b5c1c8f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-5352b8aa-8286-4fbc-9efa-06b96b5c1c8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:04.919734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:04.920724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:04.921669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 305/626] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 09:28:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:04.922776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce7a6d-817f-4d7b-a36a-833ebe4ad5ab None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:04.922776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce7a6d-817f-4d7b-a36a-833ebe4ad5ab None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:04.922776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce7a6d-817f-4d7b-a36a-833ebe4ad5ab None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:04.924075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 306/627] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:04.927689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce7a6d-817f-4d7b-a36a-833ebe4ad5ab None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:04.948289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:04.977169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ad424-a945-4026-84a5-e83ee5253945 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.014673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7f01-aa05-4048-af02-a810278e6402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.015492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7f01-aa05-4048-af02-a810278e6402 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.016065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7f01-aa05-4048-af02-a810278e6402 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.016347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e7f01-aa05-4048-af02-a810278e6402 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.024784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e7f01-aa05-4048-af02-a810278e6402 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:05.026238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e7f01-aa05-4048-af02-a810278e6402 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:05.037165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce7a6d-817f-4d7b-a36a-833ebe4ad5ab None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-281e7f01-aa05-4048-af02-a810278e6402 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:05.040153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:05.041015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 322/628] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:05.047331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7f01-aa05-4048-af02-a810278e6402 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:05.077318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d91b99-185a-40b1-9ec1-c9211a3bbb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.078209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d91b99-185a-40b1-9ec1-c9211a3bbb0b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.078495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d91b99-185a-40b1-9ec1-c9211a3bbb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.078767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d91b99-185a-40b1-9ec1-c9211a3bbb0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.091379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d91b99-185a-40b1-9ec1-c9211a3bbb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c5d91b99-185a-40b1-9ec1-c9211a3bbb0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:05.100096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:05.101067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:05.101899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:05.106086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 307/629] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:05.107084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:05.107323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727aae1-de3a-4d9c-9c75-9d4f70bf3bb2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.107617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727aae1-de3a-4d9c-9c75-9d4f70bf3bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.107906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727aae1-de3a-4d9c-9c75-9d4f70bf3bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.125085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8727aae1-de3a-4d9c-9c75-9d4f70bf3bb2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:05.126287 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8727aae1-de3a-4d9c-9c75-9d4f70bf3bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:05.160769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e7f01-aa05-4048-af02-a810278e6402 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.197428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597567-3d0e-462a-baa8-3e280f6c1fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.198103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597567-3d0e-462a-baa8-3e280f6c1fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.198391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597567-3d0e-462a-baa8-3e280f6c1fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.198671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84597567-3d0e-462a-baa8-3e280f6c1fd3 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.199539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 308/630] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:05.199663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84597567-3d0e-462a-baa8-3e280f6c1fd3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:05.199920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84597567-3d0e-462a-baa8-3e280f6c1fd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:05.200916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727aae1-de3a-4d9c-9c75-9d4f70bf3bb2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:05.201554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84597567-3d0e-462a-baa8-3e280f6c1fd3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:05.217984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:05.227873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 323/631] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 09:28:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:05.228718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597567-3d0e-462a-baa8-3e280f6c1fd3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:05.321172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727aae1-de3a-4d9c-9c75-9d4f70bf3bb2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.337283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84597567-3d0e-462a-baa8-3e280f6c1fd3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.353364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:05.356994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc917fa-7a6d-4fd3-ac00-518c0662cd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.357660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc917fa-7a6d-4fd3-ac00-518c0662cd8e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.357943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc917fa-7a6d-4fd3-ac00-518c0662cd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.358254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc917fa-7a6d-4fd3-ac00-518c0662cd8e None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.359325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc917fa-7a6d-4fd3-ac00-518c0662cd8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:05.359637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc917fa-7a6d-4fd3-ac00-518c0662cd8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:05.361205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc917fa-7a6d-4fd3-ac00-518c0662cd8e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:05.373745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 309/632] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:05.374568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc917fa-7a6d-4fd3-ac00-518c0662cd8e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:05.388011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5041e30-a073-46f1-8e13-70273efbf3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.388851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5041e30-a073-46f1-8e13-70273efbf3fe None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.389142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5041e30-a073-46f1-8e13-70273efbf3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.389425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5041e30-a073-46f1-8e13-70273efbf3fe None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.390282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5041e30-a073-46f1-8e13-70273efbf3fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:05.390482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5041e30-a073-46f1-8e13-70273efbf3fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:05.391899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5041e30-a073-46f1-8e13-70273efbf3fe None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:05.405057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 324/633] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:05.405057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5041e30-a073-46f1-8e13-70273efbf3fe None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:05.452051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:05.489265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc917fa-7a6d-4fd3-ac00-518c0662cd8e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.513457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5041e30-a073-46f1-8e13-70273efbf3fe None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.525912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3fcf7-b4be-4cf9-831b-48a6ce2fa68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.526895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3fcf7-b4be-4cf9-831b-48a6ce2fa68d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.527185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3fcf7-b4be-4cf9-831b-48a6ce2fa68d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.527837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3fcf7-b4be-4cf9-831b-48a6ce2fa68d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.540773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3fcf7-b4be-4cf9-831b-48a6ce2fa68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:05.548474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670c13-14d0-4c23-a424-e131871f8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-49b3fcf7-b4be-4cf9-831b-48a6ce2fa68d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:05.548925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:05.549869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:05.550737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:05.552035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670c13-14d0-4c23-a424-e131871f8338 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.552035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670c13-14d0-4c23-a424-e131871f8338 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.552035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15670c13-14d0-4c23-a424-e131871f8338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.555037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 310/634] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:05.555989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3fcf7-b4be-4cf9-831b-48a6ce2fa68d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:05.601625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:05.628999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670c13-14d0-4c23-a424-e131871f8338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:05.630437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15670c13-14d0-4c23-a424-e131871f8338 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:05.669267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3fcf7-b4be-4cf9-831b-48a6ce2fa68d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.696222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:05.704033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c16d9-28ae-4716-b1d0-d1d0106c0996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.704922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c16d9-28ae-4716-b1d0-d1d0106c0996 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.705210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c16d9-28ae-4716-b1d0-d1d0106c0996 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.706098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c16d9-28ae-4716-b1d0-d1d0106c0996 None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/25606976e6fe4daf9a552368088cdef1/roles/ea353bbe72d949cb9417cea310e8d194` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.721772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c16d9-28ae-4716-b1d0-d1d0106c0996 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=25606976e6fe4daf9a552368088cdef1, role_id=ea353bbe72d949cb9417cea310e8d194)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:05.723280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233c16d9-28ae-4716-b1d0-d1d0106c0996 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:05.733858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 325/635] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:28:05.734994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670c13-14d0-4c23-a424-e131871f8338 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:05.802106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:05.819008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 311/636] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:05 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/25606976e6fe4daf9a552368088cdef1/roles/ea353bbe72d949cb9417cea310e8d194 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:05.820224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c16d9-28ae-4716-b1d0-d1d0106c0996 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:05.841955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15670c13-14d0-4c23-a424-e131871f8338 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.880944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feccf0f-4087-4a46-aaed-0c0f7e394e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.882018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feccf0f-4087-4a46-aaed-0c0f7e394e10 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.882307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feccf0f-4087-4a46-aaed-0c0f7e394e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.882587 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feccf0f-4087-4a46-aaed-0c0f7e394e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.894185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feccf0f-4087-4a46-aaed-0c0f7e394e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:05.895705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feccf0f-4087-4a46-aaed-0c0f7e394e10 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-0feccf0f-4087-4a46-aaed-0c0f7e394e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:05.914565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:05.915948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:05.916841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:05.916841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:05.916841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:05.916841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:05.916841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 326/637] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:05.917558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4593bc4-3989-4700-8bfb-b530a6f4f8c6 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.917852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4593bc4-3989-4700-8bfb-b530a6f4f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.918132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4593bc4-3989-4700-8bfb-b530a6f4f8c6 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.919624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 327/638] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:05.923837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4593bc4-3989-4700-8bfb-b530a6f4f8c6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:05.941128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c16d9-28ae-4716-b1d0-d1d0106c0996 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:05.984706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905962e-b663-4655-b2cd-76695b682a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:05.985392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905962e-b663-4655-b2cd-76695b682a56 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:05.985681 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905962e-b663-4655-b2cd-76695b682a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:05.985963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905962e-b663-4655-b2cd-76695b682a56 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:05.986746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905962e-b663-4655-b2cd-76695b682a56 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:05.987620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905962e-b663-4655-b2cd-76695b682a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:05.989006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905962e-b663-4655-b2cd-76695b682a56 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:05.998300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 312/639] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:05.999080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905962e-b663-4655-b2cd-76695b682a56 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.043970 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:06.047760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4593bc4-3989-4700-8bfb-b530a6f4f8c6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.075324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:06.088190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557b387-5e21-4a64-b9ad-a7881287c406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.088987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b387-5e21-4a64-b9ad-a7881287c406 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.089269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b387-5e21-4a64-b9ad-a7881287c406 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.089544 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557b387-5e21-4a64-b9ad-a7881287c406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.100605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557b387-5e21-4a64-b9ad-a7881287c406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:06.102070 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557b387-5e21-4a64-b9ad-a7881287c406 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:06.106061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905962e-b663-4655-b2cd-76695b682a56 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-6557b387-5e21-4a64-b9ad-a7881287c406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:06.120994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:06.121955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:06.122827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:06.122827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:06.122827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:06.122827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:06.126745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 328/640] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:06.128856 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249662c-0e16-4088-98c3-eb91bd711753 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.129102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249662c-0e16-4088-98c3-eb91bd711753 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.129377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249662c-0e16-4088-98c3-eb91bd711753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.145878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92844f-ec87-41d8-9874-077a418203fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.146472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92844f-ec87-41d8-9874-077a418203fb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.146575 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0249662c-0e16-4088-98c3-eb91bd711753 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:06.146765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92844f-ec87-41d8-9874-077a418203fb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.147080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92844f-ec87-41d8-9874-077a418203fb None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.147724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0249662c-0e16-4088-98c3-eb91bd711753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:06.147823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92844f-ec87-41d8-9874-077a418203fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:06.148108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92844f-ec87-41d8-9874-077a418203fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:06.149482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92844f-ec87-41d8-9874-077a418203fb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:06.163207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 313/641] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:06.164033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92844f-ec87-41d8-9874-077a418203fb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.223434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 329/642] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:06.224714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249662c-0e16-4088-98c3-eb91bd711753 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.275539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:06.277938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92844f-ec87-41d8-9874-077a418203fb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.318748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aa9aa-6b69-4235-ae8b-51b4d14403ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.319929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aa9aa-6b69-4235-ae8b-51b4d14403ca None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.320414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aa9aa-6b69-4235-ae8b-51b4d14403ca None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.320876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aa9aa-6b69-4235-ae8b-51b4d14403ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.331539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772aa9aa-6b69-4235-ae8b-51b4d14403ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:06.333015 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772aa9aa-6b69-4235-ae8b-51b4d14403ca None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:06.345311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249662c-0e16-4088-98c3-eb91bd711753 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-772aa9aa-6b69-4235-ae8b-51b4d14403ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:06.351788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:06.352747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:06.353665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:06.353665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:06.353665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:06.353665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:06.355147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 314/643] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:06.355523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:06.355850 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aa9aa-6b69-4235-ae8b-51b4d14403ca None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.386665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9855e-d726-42fe-bdfa-8b5c2134b5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.387362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9855e-d726-42fe-bdfa-8b5c2134b5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.387648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9855e-d726-42fe-bdfa-8b5c2134b5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.387927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9855e-d726-42fe-bdfa-8b5c2134b5d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.388647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9855e-d726-42fe-bdfa-8b5c2134b5d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:06.388956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9855e-d726-42fe-bdfa-8b5c2134b5d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:06.390338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9855e-d726-42fe-bdfa-8b5c2134b5d8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:06.401709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 330/644] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:06.402269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9855e-d726-42fe-bdfa-8b5c2134b5d8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.473564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aa9aa-6b69-4235-ae8b-51b4d14403ca None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.508571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9855e-d726-42fe-bdfa-8b5c2134b5d8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.509969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607ecb5-1cd6-40f9-a20d-8291f18637e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.510785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607ecb5-1cd6-40f9-a20d-8291f18637e7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.511211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607ecb5-1cd6-40f9-a20d-8291f18637e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.511495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607ecb5-1cd6-40f9-a20d-8291f18637e7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.519401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607ecb5-1cd6-40f9-a20d-8291f18637e7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:06.520975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c607ecb5-1cd6-40f9-a20d-8291f18637e7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c607ecb5-1cd6-40f9-a20d-8291f18637e7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:06.537964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:06.539012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 315/645] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:06.540104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607ecb5-1cd6-40f9-a20d-8291f18637e7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.550122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2e8ed-fd7e-41e1-97ca-849ee4c72753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.551449 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2e8ed-fd7e-41e1-97ca-849ee4c72753 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.551794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2e8ed-fd7e-41e1-97ca-849ee4c72753 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.552009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2e8ed-fd7e-41e1-97ca-849ee4c72753 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.556651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:06.563847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2e8ed-fd7e-41e1-97ca-849ee4c72753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1aa2e8ed-fd7e-41e1-97ca-849ee4c72753 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:06.572236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:06.573159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:06.574041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 331/646] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:06.574878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2e8ed-fd7e-41e1-97ca-849ee4c72753 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.607541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:06.661914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607ecb5-1cd6-40f9-a20d-8291f18637e7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.695174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2e8ed-fd7e-41e1-97ca-849ee4c72753 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.698659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e73781-33fc-47e8-b114-8e97f990f075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.699656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e73781-33fc-47e8-b114-8e97f990f075 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.699849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e73781-33fc-47e8-b114-8e97f990f075 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.700179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e73781-33fc-47e8-b114-8e97f990f075 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.700827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e73781-33fc-47e8-b114-8e97f990f075 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:06.701136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e73781-33fc-47e8-b114-8e97f990f075 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:06.702517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e73781-33fc-47e8-b114-8e97f990f075 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:06.714082 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 316/647] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:06.714912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e73781-33fc-47e8-b114-8e97f990f075 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.735419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91a783-9d9d-4505-8c1c-c5738b48f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.736650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91a783-9d9d-4505-8c1c-c5738b48f0fa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.737703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91a783-9d9d-4505-8c1c-c5738b48f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.738180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91a783-9d9d-4505-8c1c-c5738b48f0fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.745292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91a783-9d9d-4505-8c1c-c5738b48f0fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:06.746659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91a783-9d9d-4505-8c1c-c5738b48f0fa None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-af91a783-9d9d-4505-8c1c-c5738b48f0fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:06.761475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:06.762380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 332/648] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:06.764002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91a783-9d9d-4505-8c1c-c5738b48f0fa None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.801056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:06.832559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e73781-33fc-47e8-b114-8e97f990f075 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.850279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:06.866593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91a783-9d9d-4505-8c1c-c5738b48f0fa None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:06.868876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60b6b3-db82-40da-b7e7-313e438a2ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.869587 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60b6b3-db82-40da-b7e7-313e438a2ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.869875 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60b6b3-db82-40da-b7e7-313e438a2ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.870231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60b6b3-db82-40da-b7e7-313e438a2ae5 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.871031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60b6b3-db82-40da-b7e7-313e438a2ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:06.871347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60b6b3-db82-40da-b7e7-313e438a2ae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:06.872789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60b6b3-db82-40da-b7e7-313e438a2ae5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:06.892466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 317/649] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:06.893741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60b6b3-db82-40da-b7e7-313e438a2ae5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:06.910517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76d426-130f-453e-bf28-f1ab5561b31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:06.911232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76d426-130f-453e-bf28-f1ab5561b31a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:06.911521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76d426-130f-453e-bf28-f1ab5561b31a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:06.911801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76d426-130f-453e-bf28-f1ab5561b31a None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:06.912606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76d426-130f-453e-bf28-f1ab5561b31a None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:06.912862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76d426-130f-453e-bf28-f1ab5561b31a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:06.914235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76d426-130f-453e-bf28-f1ab5561b31a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:06.922874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 333/650] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:06.923751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76d426-130f-453e-bf28-f1ab5561b31a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:07.002311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60b6b3-db82-40da-b7e7-313e438a2ae5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.033675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:07.034373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76d426-130f-453e-bf28-f1ab5561b31a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.041279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a12b94-2b23-45ad-beb1-b2a80a58bb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.042072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a12b94-2b23-45ad-beb1-b2a80a58bb25 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.042354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a12b94-2b23-45ad-beb1-b2a80a58bb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.042628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a12b94-2b23-45ad-beb1-b2a80a58bb25 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:07.050414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a12b94-2b23-45ad-beb1-b2a80a58bb25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:07.051954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a12b94-2b23-45ad-beb1-b2a80a58bb25 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-53a12b94-2b23-45ad-beb1-b2a80a58bb25 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:07.067614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:07.068660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 09:28:07.069608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:07.073849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 318/651] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:07.074652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a12b94-2b23-45ad-beb1-b2a80a58bb25 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:07.077695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c4b1e-76e8-47f5-b208-3bdca76da8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.078372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c4b1e-76e8-47f5-b208-3bdca76da8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.078669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c4b1e-76e8-47f5-b208-3bdca76da8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.078987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c4b1e-76e8-47f5-b208-3bdca76da8c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:07.079786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c4b1e-76e8-47f5-b208-3bdca76da8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:07.080102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c4b1e-76e8-47f5-b208-3bdca76da8c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:07.081749 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c4b1e-76e8-47f5-b208-3bdca76da8c6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:07.094292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 334/652] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:07.095203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c4b1e-76e8-47f5-b208-3bdca76da8c6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:07.106210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:07.185424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a12b94-2b23-45ad-beb1-b2a80a58bb25 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.206609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c4b1e-76e8-47f5-b208-3bdca76da8c6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.218638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d41be-cf0e-4e83-b165-de84d6e804a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.219325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d41be-cf0e-4e83-b165-de84d6e804a5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.219609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d41be-cf0e-4e83-b165-de84d6e804a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.219886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d41be-cf0e-4e83-b165-de84d6e804a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:07.243705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300cb42-31c6-4379-a36b-8a1c84baf542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.244621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300cb42-31c6-4379-a36b-8a1c84baf542 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.244910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300cb42-31c6-4379-a36b-8a1c84baf542 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.245312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300cb42-31c6-4379-a36b-8a1c84baf542 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:07.256444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300cb42-31c6-4379-a36b-8a1c84baf542 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:07.257965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300cb42-31c6-4379-a36b-8a1c84baf542 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:07.276884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-8300cb42-31c6-4379-a36b-8a1c84baf542 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:07.277953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:07.278987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:07.279978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:07.279978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:07.279978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:07.279978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:07.284092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 335/653] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:07.285060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300cb42-31c6-4379-a36b-8a1c84baf542 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:07.290669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d41be-cf0e-4e83-b165-de84d6e804a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:07.292178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d41be-cf0e-4e83-b165-de84d6e804a5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:07.346660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:07.390281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300cb42-31c6-4379-a36b-8a1c84baf542 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.402541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 319/654] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:28:07.404094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d41be-cf0e-4e83-b165-de84d6e804a5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:07.430621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a19cb-a44c-4544-a436-8ef51fa318c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.431335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a19cb-a44c-4544-a436-8ef51fa318c0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.431622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a19cb-a44c-4544-a436-8ef51fa318c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.431901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a19cb-a44c-4544-a436-8ef51fa318c0 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:07.432769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a19cb-a44c-4544-a436-8ef51fa318c0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:07.433066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a19cb-a44c-4544-a436-8ef51fa318c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:07.434502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a19cb-a44c-4544-a436-8ef51fa318c0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:07.452683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 336/655] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 09:28:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:07.453428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a19cb-a44c-4544-a436-8ef51fa318c0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:07.506545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:07.516802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d41be-cf0e-4e83-b165-de84d6e804a5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.552733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1617-bdde-4306-8b3e-12a635c30597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.553404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1617-bdde-4306-8b3e-12a635c30597 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.553689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1617-bdde-4306-8b3e-12a635c30597 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.554025 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1617-bdde-4306-8b3e-12a635c30597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:07.554879 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed1617-bdde-4306-8b3e-12a635c30597 None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=0422e6863c7147b79ea4d194e6e07154) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:07.555206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed1617-bdde-4306-8b3e-12a635c30597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:07.556651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed1617-bdde-4306-8b3e-12a635c30597 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:07.562530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 320/656] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:07 2022] GET /identity/v3/role_assignments?user.id=0422e6863c7147b79ea4d194e6e07154&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:07.563412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1617-bdde-4306-8b3e-12a635c30597 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:07.573885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a19cb-a44c-4544-a436-8ef51fa318c0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.601405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:07.621288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dca5b0-4de7-4a30-a871-b01982bf57a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.622141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dca5b0-4de7-4a30-a871-b01982bf57a0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.622264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dca5b0-4de7-4a30-a871-b01982bf57a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.622533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dca5b0-4de7-4a30-a871-b01982bf57a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:07.623329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dca5b0-4de7-4a30-a871-b01982bf57a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:07.623671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dca5b0-4de7-4a30-a871-b01982bf57a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:07.625062 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dca5b0-4de7-4a30-a871-b01982bf57a0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:07.644502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 337/657] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:07.645495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dca5b0-4de7-4a30-a871-b01982bf57a0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:07.729525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1617-bdde-4306-8b3e-12a635c30597 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.766992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dca5b0-4de7-4a30-a871-b01982bf57a0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.775462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cce1b-07ad-45d6-9772-1cb6acb20532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.776266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cce1b-07ad-45d6-9772-1cb6acb20532 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.776554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cce1b-07ad-45d6-9772-1cb6acb20532 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.776848 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cce1b-07ad-45d6-9772-1cb6acb20532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:07.791372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cce1b-07ad-45d6-9772-1cb6acb20532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:07.792483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cce1b-07ad-45d6-9772-1cb6acb20532 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:07.814476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74217e0a-a175-496a-afe4-83885d868acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.815902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74217e0a-a175-496a-afe4-83885d868acb None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.816194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74217e0a-a175-496a-afe4-83885d868acb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.816474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74217e0a-a175-496a-afe4-83885d868acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-151cce1b-07ad-45d6-9772-1cb6acb20532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:07.817245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:07.818246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:07.819415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:07.819415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:07.819415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:07.819415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:07.822980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 321/658] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:07.822980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cce1b-07ad-45d6-9772-1cb6acb20532 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:07.842337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:07.878903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:07.904069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74217e0a-a175-496a-afe4-83885d868acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:07.905537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74217e0a-a175-496a-afe4-83885d868acb None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:07.954218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cce1b-07ad-45d6-9772-1cb6acb20532 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:07.994334 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c0aa4-18e5-4642-b9f5-0a5bdc1e4e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:07.995091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c0aa4-18e5-4642-b9f5-0a5bdc1e4e6d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:07.995380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c0aa4-18e5-4642-b9f5-0a5bdc1e4e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:07.995658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c0aa4-18e5-4642-b9f5-0a5bdc1e4e6d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.004399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c0aa4-18e5-4642-b9f5-0a5bdc1e4e6d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:08.005860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c0aa4-18e5-4642-b9f5-0a5bdc1e4e6d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:08.014908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 338/659] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:28:08.015592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74217e0a-a175-496a-afe4-83885d868acb None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-8e5c0aa4-18e5-4642-b9f5-0a5bdc1e4e6d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:08.021053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:08.021974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 09:28:08.022966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:08.026782 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 322/660] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:08.028180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0700a3-2c46-4b1f-a5a4-7fa35c46cd56 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.028504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0700a3-2c46-4b1f-a5a4-7fa35c46cd56 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.028789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0700a3-2c46-4b1f-a5a4-7fa35c46cd56 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.030085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 323/661] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:08.030784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0700a3-2c46-4b1f-a5a4-7fa35c46cd56 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.105524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:08.107504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:08.127377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74217e0a-a175-496a-afe4-83885d868acb None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:08.148298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0700a3-2c46-4b1f-a5a4-7fa35c46cd56 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:08.169120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303f285-3aa0-42a0-8757-d108a404a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:08.169785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303f285-3aa0-42a0-8757-d108a404a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.170073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303f285-3aa0-42a0-8757-d108a404a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.170350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303f285-3aa0-42a0-8757-d108a404a5f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.171098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303f285-3aa0-42a0-8757-d108a404a5f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:08.171404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303f285-3aa0-42a0-8757-d108a404a5f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:08.172763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303f285-3aa0-42a0-8757-d108a404a5f6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:08.190417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 339/662] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:08.190417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303f285-3aa0-42a0-8757-d108a404a5f6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.192951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d0c29-31eb-4114-8ecd-d467b514e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:08.193802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d0c29-31eb-4114-8ecd-d467b514e3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.194137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d0c29-31eb-4114-8ecd-d467b514e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.195179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d0c29-31eb-4114-8ecd-d467b514e3e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.206361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d0c29-31eb-4114-8ecd-d467b514e3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:08.207874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d0c29-31eb-4114-8ecd-d467b514e3e4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-8b7d0c29-31eb-4114-8ecd-d467b514e3e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:08.228125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:08.229167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:08.230096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:08.230096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:08.230096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:08.230096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:08.234000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 324/663] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:08.235323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e1fb1-9f66-48f2-944f-e05fcf1ebb7e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.235616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e1fb1-9f66-48f2-944f-e05fcf1ebb7e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.235897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e1fb1-9f66-48f2-944f-e05fcf1ebb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.254178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-548e1fb1-9f66-48f2-944f-e05fcf1ebb7e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:08.255630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-548e1fb1-9f66-48f2-944f-e05fcf1ebb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:08.293613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303f285-3aa0-42a0-8757-d108a404a5f6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:08.325639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 325/664] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:08.326493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e1fb1-9f66-48f2-944f-e05fcf1ebb7e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.338758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5068-18bc-4cc7-b4a4-804a1d01b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:08.339938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5068-18bc-4cc7-b4a4-804a1d01b80b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.340369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5068-18bc-4cc7-b4a4-804a1d01b80b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.341033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5068-18bc-4cc7-b4a4-804a1d01b80b None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.342484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d5068-18bc-4cc7-b4a4-804a1d01b80b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:08.342979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d5068-18bc-4cc7-b4a4-804a1d01b80b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:08.345032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d5068-18bc-4cc7-b4a4-804a1d01b80b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:08.355903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:08.366778 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 340/665] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:08.369836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5068-18bc-4cc7-b4a4-804a1d01b80b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.383127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:08.439072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e1fb1-9f66-48f2-944f-e05fcf1ebb7e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:08.474991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5068-18bc-4cc7-b4a4-804a1d01b80b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:08.481927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee8ffb-fdbc-49e8-b405-a96ccd91fd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:08.483365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee8ffb-fdbc-49e8-b405-a96ccd91fd86 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.483803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee8ffb-fdbc-49e8-b405-a96ccd91fd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.484504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee8ffb-fdbc-49e8-b405-a96ccd91fd86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.492592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee8ffb-fdbc-49e8-b405-a96ccd91fd86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:08.494061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee8ffb-fdbc-49e8-b405-a96ccd91fd86 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-43ee8ffb-fdbc-49e8-b405-a96ccd91fd86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:08.508518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:08.509553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 326/666] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:08.510448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee8ffb-fdbc-49e8-b405-a96ccd91fd86 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.517974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47327d-876c-4877-b4f5-ca0e4800f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:08.519345 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47327d-876c-4877-b4f5-ca0e4800f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.519671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47327d-876c-4877-b4f5-ca0e4800f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.519920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47327d-876c-4877-b4f5-ca0e4800f2b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.520644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47327d-876c-4877-b4f5-ca0e4800f2b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:08.520948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47327d-876c-4877-b4f5-ca0e4800f2b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:08.522305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47327d-876c-4877-b4f5-ca0e4800f2b8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:08.539286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 341/667] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:08.539286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47327d-876c-4877-b4f5-ca0e4800f2b8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.603882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:08.623467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee8ffb-fdbc-49e8-b405-a96ccd91fd86 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:08.632972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:08.651183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47327d-876c-4877-b4f5-ca0e4800f2b8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:08.658322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f29f6-08d0-4e83-a0df-8a92b5426901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:08.659193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f29f6-08d0-4e83-a0df-8a92b5426901 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.659613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f29f6-08d0-4e83-a0df-8a92b5426901 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.659887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f29f6-08d0-4e83-a0df-8a92b5426901 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.671865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f29f6-08d0-4e83-a0df-8a92b5426901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-0a4f29f6-08d0-4e83-a0df-8a92b5426901 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:08.681135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:08.682058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:08.682919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 327/668] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:08.684231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f29f6-08d0-4e83-a0df-8a92b5426901 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.692807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3208e0-24fc-4098-8925-258e72f35e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:08.693469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3208e0-24fc-4098-8925-258e72f35e78 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.693759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3208e0-24fc-4098-8925-258e72f35e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.694033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3208e0-24fc-4098-8925-258e72f35e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.769738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3208e0-24fc-4098-8925-258e72f35e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:08.771175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3208e0-24fc-4098-8925-258e72f35e78 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:08.791685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f29f6-08d0-4e83-a0df-8a92b5426901 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:08.829255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42ea70-a8bc-4622-b4e4-484c6ec67dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:08.829920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42ea70-a8bc-4622-b4e4-484c6ec67dfd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.830205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42ea70-a8bc-4622-b4e4-484c6ec67dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.830528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42ea70-a8bc-4622-b4e4-484c6ec67dfd None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:08.831976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42ea70-a8bc-4622-b4e4-484c6ec67dfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:08.832288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42ea70-a8bc-4622-b4e4-484c6ec67dfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:08.833730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42ea70-a8bc-4622-b4e4-484c6ec67dfd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:08.835445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:08.850936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 328/669] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:08.850936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42ea70-a8bc-4622-b4e4-484c6ec67dfd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.878326 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:08.890829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 342/670] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:28:08.896748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3208e0-24fc-4098-8925-258e72f35e78 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:08.958386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42ea70-a8bc-4622-b4e4-484c6ec67dfd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:08.996186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b1046-c16f-472a-98b9-d7fe6e60a571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:08.996974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b1046-c16f-472a-98b9-d7fe6e60a571 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:08.997261 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b1046-c16f-472a-98b9-d7fe6e60a571 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:08.997535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b1046-c16f-472a-98b9-d7fe6e60a571 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.004793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b1046-c16f-472a-98b9-d7fe6e60a571 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.005540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3208e0-24fc-4098-8925-258e72f35e78 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:09.006237 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b1046-c16f-472a-98b9-d7fe6e60a571 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-592b1046-c16f-472a-98b9-d7fe6e60a571 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:09.020646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:09.021571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 329/671] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:09.027267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b1046-c16f-472a-98b9-d7fe6e60a571 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.044422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48cf97-9fce-46e1-aafd-72f42e244981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:09.045097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48cf97-9fce-46e1-aafd-72f42e244981 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.045382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48cf97-9fce-46e1-aafd-72f42e244981 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.045665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48cf97-9fce-46e1-aafd-72f42e244981 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.046413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48cf97-9fce-46e1-aafd-72f42e244981 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:09.046721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48cf97-9fce-46e1-aafd-72f42e244981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.048124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48cf97-9fce-46e1-aafd-72f42e244981 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.056758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 343/672] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:09.057536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48cf97-9fce-46e1-aafd-72f42e244981 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.077184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:09.122930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:09.135896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b1046-c16f-472a-98b9-d7fe6e60a571 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:09.162455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48cf97-9fce-46e1-aafd-72f42e244981 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:09.170040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134c9d7-4dbe-4090-9c1f-800e9004a88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:09.170702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134c9d7-4dbe-4090-9c1f-800e9004a88e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.171022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134c9d7-4dbe-4090-9c1f-800e9004a88e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.171303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134c9d7-4dbe-4090-9c1f-800e9004a88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.172138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134c9d7-4dbe-4090-9c1f-800e9004a88e None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=ee91a24eb66d4753bc6a81d278b1088f) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:09.172454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134c9d7-4dbe-4090-9c1f-800e9004a88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.173900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134c9d7-4dbe-4090-9c1f-800e9004a88e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.190880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 330/673] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/role_assignments?user.id=ee91a24eb66d4753bc6a81d278b1088f&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:09.190880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134c9d7-4dbe-4090-9c1f-800e9004a88e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.211762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d54c-3ee2-4448-af3a-3512d0ddd044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:09.212679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d54c-3ee2-4448-af3a-3512d0ddd044 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.213043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d54c-3ee2-4448-af3a-3512d0ddd044 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.213395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433d54c-3ee2-4448-af3a-3512d0ddd044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.226512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433d54c-3ee2-4448-af3a-3512d0ddd044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.228211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433d54c-3ee2-4448-af3a-3512d0ddd044 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-b433d54c-3ee2-4448-af3a-3512d0ddd044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:09.249050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:09.250179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:09.251268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:09.251268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:09.251268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:09.251268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:09.254206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 344/674] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:09.254206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d54c-3ee2-4448-af3a-3512d0ddd044 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.332200 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134c9d7-4dbe-4090-9c1f-800e9004a88e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:09.335102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:09.372930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433d54c-3ee2-4448-af3a-3512d0ddd044 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:09.390109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebf5a2-71cd-41a1-b695-c592e049f636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:09.390819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebf5a2-71cd-41a1-b695-c592e049f636 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.391155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebf5a2-71cd-41a1-b695-c592e049f636 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.391432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebf5a2-71cd-41a1-b695-c592e049f636 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.392226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebf5a2-71cd-41a1-b695-c592e049f636 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:09.392536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebf5a2-71cd-41a1-b695-c592e049f636 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.394185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ebf5a2-71cd-41a1-b695-c592e049f636 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.407747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 331/675] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:09.408628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebf5a2-71cd-41a1-b695-c592e049f636 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.422614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6cf80-f045-400d-9a16-5a1723cc09b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:09.423463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6cf80-f045-400d-9a16-5a1723cc09b9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.423748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6cf80-f045-400d-9a16-5a1723cc09b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.424027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc6cf80-f045-400d-9a16-5a1723cc09b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.429463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:09.437225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6cf80-f045-400d-9a16-5a1723cc09b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.438682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc6cf80-f045-400d-9a16-5a1723cc09b9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-8fc6cf80-f045-400d-9a16-5a1723cc09b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:09.458538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:09.459508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:09.460807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:09.460807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:09.460807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:09.460807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:09.460807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 345/676] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:09.461095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6cf80-f045-400d-9a16-5a1723cc09b9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.543008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ebf5a2-71cd-41a1-b695-c592e049f636 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:09.587793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a0261-7a8c-411a-a86d-fb99bf815a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:09.588393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a0261-7a8c-411a-a86d-fb99bf815a1d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.588680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a0261-7a8c-411a-a86d-fb99bf815a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.588962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a0261-7a8c-411a-a86d-fb99bf815a1d None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.589696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a0261-7a8c-411a-a86d-fb99bf815a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:09.590007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a0261-7a8c-411a-a86d-fb99bf815a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.592242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a0261-7a8c-411a-a86d-fb99bf815a1d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.598902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc6cf80-f045-400d-9a16-5a1723cc09b9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:09.614222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 332/677] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:09.615490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a0261-7a8c-411a-a86d-fb99bf815a1d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.625108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:09.638176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb21be-ebbf-4bc9-a89a-951f222452cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:09.638914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb21be-ebbf-4bc9-a89a-951f222452cb None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.639610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb21be-ebbf-4bc9-a89a-951f222452cb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.639737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb21be-ebbf-4bc9-a89a-951f222452cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.640481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb21be-ebbf-4bc9-a89a-951f222452cb None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=d0a8a5a1bc174acd9b13477c7d4b4a07) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:09.640801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb21be-ebbf-4bc9-a89a-951f222452cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.642240 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb21be-ebbf-4bc9-a89a-951f222452cb None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.648861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 346/678] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/role_assignments?user.id=d0a8a5a1bc174acd9b13477c7d4b4a07&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:09.649766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb21be-ebbf-4bc9-a89a-951f222452cb None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.724960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:09.771474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb21be-ebbf-4bc9-a89a-951f222452cb None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:09.794107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a0261-7a8c-411a-a86d-fb99bf815a1d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:09.812727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ea660-68c2-4ace-bb72-3da8dd473dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:09.814044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ea660-68c2-4ace-bb72-3da8dd473dce None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.814580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ea660-68c2-4ace-bb72-3da8dd473dce None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.815646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ea660-68c2-4ace-bb72-3da8dd473dce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.823887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ea660-68c2-4ace-bb72-3da8dd473dce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.825662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ea660-68c2-4ace-bb72-3da8dd473dce None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.835903 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edc03b-ceba-4c2e-919a-51327abf8520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:09.836901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edc03b-ceba-4c2e-919a-51327abf8520 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.837370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edc03b-ceba-4c2e-919a-51327abf8520 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.837915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edc03b-ceba-4c2e-919a-51327abf8520 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.838867 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edc03b-ceba-4c2e-919a-51327abf8520 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:09.839363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edc03b-ceba-4c2e-919a-51327abf8520 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:09.841070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edc03b-ceba-4c2e-919a-51327abf8520 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-803ea660-68c2-4ace-bb72-3da8dd473dce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:09.843034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:09.843931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:09.845050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:09.845050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:09.845050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:09.845050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:09.845050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:09.845050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:09.845050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:09.845050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:09.845050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 347/679] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:09.847111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1e16-ddab-4d5e-ac89-cfd5130c7b80 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.847499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1e16-ddab-4d5e-ac89-cfd5130c7b80 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.847882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd1e16-ddab-4d5e-ac89-cfd5130c7b80 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.849571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 348/680] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:09.850683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd1e16-ddab-4d5e-ac89-cfd5130c7b80 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.860953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 333/681] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:09.863653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36a431-b5d4-47a4-afd8-de05172f62f7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:09.864135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36a431-b5d4-47a4-afd8-de05172f62f7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:09.864609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36a431-b5d4-47a4-afd8-de05172f62f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:09.889356 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7f36a431-b5d4-47a4-afd8-de05172f62f7 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:09.891049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7f36a431-b5d4-47a4-afd8-de05172f62f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:09.911227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:09.980305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 334/682] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:09.980305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36a431-b5d4-47a4-afd8-de05172f62f7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:09.991403 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd1e16-ddab-4d5e-ac89-cfd5130c7b80 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:10.033216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58518c61-aceb-4cae-913c-fadb658c4d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:10.034438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518c61-aceb-4cae-913c-fadb658c4d3c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:10.034727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518c61-aceb-4cae-913c-fadb658c4d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:10.035073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58518c61-aceb-4cae-913c-fadb658c4d3c None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:10.035883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58518c61-aceb-4cae-913c-fadb658c4d3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:10.038598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58518c61-aceb-4cae-913c-fadb658c4d3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:10.038598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58518c61-aceb-4cae-913c-fadb658c4d3c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:10.050801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 349/683] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:10.051682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58518c61-aceb-4cae-913c-fadb658c4d3c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:10.063006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:10.109475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36a431-b5d4-47a4-afd8-de05172f62f7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:10.145312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fe00b-ee69-4564-a937-b8ace154e903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:10.146165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fe00b-ee69-4564-a937-b8ace154e903 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:10.146456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fe00b-ee69-4564-a937-b8ace154e903 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:10.146736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fe00b-ee69-4564-a937-b8ace154e903 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:10.154105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fe00b-ee69-4564-a937-b8ace154e903 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:10.155589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fe00b-ee69-4564-a937-b8ace154e903 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ae9fe00b-ee69-4564-a937-b8ace154e903 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:10.170457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:10.171480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 335/684] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:10.172853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fe00b-ee69-4564-a937-b8ace154e903 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:10.185899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58518c61-aceb-4cae-913c-fadb658c4d3c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:10.193996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:10.222538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789075-21a9-4e90-96b7-b496ee45f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:10.223368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789075-21a9-4e90-96b7-b496ee45f360 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:10.223659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789075-21a9-4e90-96b7-b496ee45f360 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:10.223939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789075-21a9-4e90-96b7-b496ee45f360 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:10.235755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78789075-21a9-4e90-96b7-b496ee45f360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-78789075-21a9-4e90-96b7-b496ee45f360 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:10.244061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:10.246299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 350/685] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:10.247663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789075-21a9-4e90-96b7-b496ee45f360 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:10.287472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fe00b-ee69-4564-a937-b8ace154e903 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:10.312348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:10.324599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2b6d-c78d-4fe3-9dc6-c65c78a44261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:10.325535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2b6d-c78d-4fe3-9dc6-c65c78a44261 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:10.326010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2b6d-c78d-4fe3-9dc6-c65c78a44261 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:10.326480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2b6d-c78d-4fe3-9dc6-c65c78a44261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:10.327497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2b6d-c78d-4fe3-9dc6-c65c78a44261 None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=9b2db60c511f4fd29b772ca5fb014d03) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:10.327988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2b6d-c78d-4fe3-9dc6-c65c78a44261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:10.329581 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2b6d-c78d-4fe3-9dc6-c65c78a44261 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:10.336663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 336/686] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:10 2022] GET /identity/v3/role_assignments?user.id=9b2db60c511f4fd29b772ca5fb014d03&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:10.337827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2b6d-c78d-4fe3-9dc6-c65c78a44261 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:10.379574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789075-21a9-4e90-96b7-b496ee45f360 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:10.454830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2b6d-c78d-4fe3-9dc6-c65c78a44261 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:10.491600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe824d-3bc0-41a3-87d1-61ef8623fce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:10.492306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe824d-3bc0-41a3-87d1-61ef8623fce5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:10.492591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe824d-3bc0-41a3-87d1-61ef8623fce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:10.492869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe824d-3bc0-41a3-87d1-61ef8623fce5 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:10.493771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe824d-3bc0-41a3-87d1-61ef8623fce5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:10.494035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe824d-3bc0-41a3-87d1-61ef8623fce5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:10.495537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe824d-3bc0-41a3-87d1-61ef8623fce5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:10.499066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b8d0b-9c61-49c0-835b-5cd0b82af99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:10.500158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8d0b-9c61-49c0-835b-5cd0b82af99e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:10.500590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8d0b-9c61-49c0-835b-5cd0b82af99e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:10.501013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b8d0b-9c61-49c0-835b-5cd0b82af99e None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:10.501935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b8d0b-9c61-49c0-835b-5cd0b82af99e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:10.503104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b8d0b-9c61-49c0-835b-5cd0b82af99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:10.504891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b8d0b-9c61-49c0-835b-5cd0b82af99e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:10.515434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 337/687] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:10.521988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b8d0b-9c61-49c0-835b-5cd0b82af99e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:10.538903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 351/688] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 09:28:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:10.544438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe824d-3bc0-41a3-87d1-61ef8623fce5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:10.576962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:10.597733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:10.655357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b8d0b-9c61-49c0-835b-5cd0b82af99e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:10.688581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe824d-3bc0-41a3-87d1-61ef8623fce5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:10.696219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010b3f3-d682-42d9-9937-44e3d591fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:10.697225 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b3f3-d682-42d9-9937-44e3d591fd8d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:10.697768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b3f3-d682-42d9-9937-44e3d591fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:10.698180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010b3f3-d682-42d9-9937-44e3d591fd8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:10.710185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010b3f3-d682-42d9-9937-44e3d591fd8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:10.711986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010b3f3-d682-42d9-9937-44e3d591fd8d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:10.729201 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21993f8-961b-45ad-ac04-8a49622e6832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:10.729987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21993f8-961b-45ad-ac04-8a49622e6832 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:10.730395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21993f8-961b-45ad-ac04-8a49622e6832 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:10.730776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21993f8-961b-45ad-ac04-8a49622e6832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-4010b3f3-d682-42d9-9937-44e3d591fd8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:10.731975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:10.733029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:10.734115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:10.734115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:10.734115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:10.734115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:10.736309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 338/689] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:10.742695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010b3f3-d682-42d9-9937-44e3d591fd8d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:10.807995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21993f8-961b-45ad-ac04-8a49622e6832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:10.809830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21993f8-961b-45ad-ac04-8a49622e6832 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:10.836515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:10.848685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:10.851810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010b3f3-d682-42d9-9937-44e3d591fd8d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:10.889682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e273e20-b884-4be7-800d-e3d7765909fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:10.890698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e273e20-b884-4be7-800d-e3d7765909fe None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:10.891224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e273e20-b884-4be7-800d-e3d7765909fe None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:10.891682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e273e20-b884-4be7-800d-e3d7765909fe None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:10.892621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e273e20-b884-4be7-800d-e3d7765909fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:10.893202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e273e20-b884-4be7-800d-e3d7765909fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:10.894904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e273e20-b884-4be7-800d-e3d7765909fe None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:10.908509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 339/690] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:10.914110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e273e20-b884-4be7-800d-e3d7765909fe None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:10.919251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 352/691] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 09:28:10.925858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21993f8-961b-45ad-ac04-8a49622e6832 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:11.026512 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e273e20-b884-4be7-800d-e3d7765909fe None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:11.037579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21993f8-961b-45ad-ac04-8a49622e6832 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:11.063060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:11.066120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934812fb-7553-4ddc-83e5-a34d94a92517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:11.067163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934812fb-7553-4ddc-83e5-a34d94a92517 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.067631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934812fb-7553-4ddc-83e5-a34d94a92517 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.068141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934812fb-7553-4ddc-83e5-a34d94a92517 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.075076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206842f-3ba2-4da8-86cb-2c784de3a002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:11.075875 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206842f-3ba2-4da8-86cb-2c784de3a002 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.076168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206842f-3ba2-4da8-86cb-2c784de3a002 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.076451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206842f-3ba2-4da8-86cb-2c784de3a002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.078022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934812fb-7553-4ddc-83e5-a34d94a92517 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:11.079737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934812fb-7553-4ddc-83e5-a34d94a92517 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:11.088285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206842f-3ba2-4da8-86cb-2c784de3a002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:11.089758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206842f-3ba2-4da8-86cb-2c784de3a002 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-934812fb-7553-4ddc-83e5-a34d94a92517 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:11.097142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:11.098164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:11.099139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:11.101930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 340/692] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 09:28:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:11.107434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934812fb-7553-4ddc-83e5-a34d94a92517 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a206842f-3ba2-4da8-86cb-2c784de3a002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:11.108923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:11.110039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:11.110974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:11.110974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:11.110974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:11.110974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:11.110974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 353/693] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:11.116538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206842f-3ba2-4da8-86cb-2c784de3a002 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:11.164357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:11.222388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206842f-3ba2-4da8-86cb-2c784de3a002 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:11.282947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934812fb-7553-4ddc-83e5-a34d94a92517 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:11.308588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf936e76-84fd-4b81-bbd9-311843f510d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:11.309258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf936e76-84fd-4b81-bbd9-311843f510d1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.309546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf936e76-84fd-4b81-bbd9-311843f510d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.309827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf936e76-84fd-4b81-bbd9-311843f510d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.310555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf936e76-84fd-4b81-bbd9-311843f510d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:11.310880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf936e76-84fd-4b81-bbd9-311843f510d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:11.312258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf936e76-84fd-4b81-bbd9-311843f510d1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:11.336914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 354/694] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:11.342628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf936e76-84fd-4b81-bbd9-311843f510d1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:11.351222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddec2cb-63f1-46e4-8da6-b92f8c467fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:11.351908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddec2cb-63f1-46e4-8da6-b92f8c467fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.352194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddec2cb-63f1-46e4-8da6-b92f8c467fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.352478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddec2cb-63f1-46e4-8da6-b92f8c467fc1 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.353324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddec2cb-63f1-46e4-8da6-b92f8c467fc1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:11.353641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddec2cb-63f1-46e4-8da6-b92f8c467fc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:11.355122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddec2cb-63f1-46e4-8da6-b92f8c467fc1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:11.395457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 341/695] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 09:28:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:11.401120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddec2cb-63f1-46e4-8da6-b92f8c467fc1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:11.411200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:11.479383 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf936e76-84fd-4b81-bbd9-311843f510d1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:11.516814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa53f7-c839-4282-9a4d-48abd79fdb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:11.517629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa53f7-c839-4282-9a4d-48abd79fdb7e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.517924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa53f7-c839-4282-9a4d-48abd79fdb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.518732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa53f7-c839-4282-9a4d-48abd79fdb7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.526713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa53f7-c839-4282-9a4d-48abd79fdb7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:11.528251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa53f7-c839-4282-9a4d-48abd79fdb7e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-39aa53f7-c839-4282-9a4d-48abd79fdb7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:11.546645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:11.547610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:11.548492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:11.548492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:11.548492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:11.548492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:11.548492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:11.548492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:11.548492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:11.548492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:11.548492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 355/696] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:11.555222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa53f7-c839-4282-9a4d-48abd79fdb7e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:11.656326 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:11.666982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa53f7-c839-4282-9a4d-48abd79fdb7e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:11.678201 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:11.705704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb7d2f-ccc0-4df3-b9a4-f216293a0e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:11.706441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb7d2f-ccc0-4df3-b9a4-f216293a0e9f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.706731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb7d2f-ccc0-4df3-b9a4-f216293a0e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.707169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb7d2f-ccc0-4df3-b9a4-f216293a0e9f None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.707982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb7d2f-ccc0-4df3-b9a4-f216293a0e9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:11.708296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb7d2f-ccc0-4df3-b9a4-f216293a0e9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:11.709850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb7d2f-ccc0-4df3-b9a4-f216293a0e9f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:11.724287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 356/697] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:11.732360 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb7d2f-ccc0-4df3-b9a4-f216293a0e9f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:11.736298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddec2cb-63f1-46e4-8da6-b92f8c467fc1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:11.775060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de59e8-75d2-47ae-9377-ce840475feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:11.775715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de59e8-75d2-47ae-9377-ce840475feac None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.776002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de59e8-75d2-47ae-9377-ce840475feac None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.776279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de59e8-75d2-47ae-9377-ce840475feac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.844505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb7d2f-ccc0-4df3-b9a4-f216293a0e9f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:11.856410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de59e8-75d2-47ae-9377-ce840475feac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:11.858382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de59e8-75d2-47ae-9377-ce840475feac None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:11.881303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758930a7-d010-451d-80f9-de6dac26dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:11.882198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758930a7-d010-451d-80f9-de6dac26dd06 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.882605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758930a7-d010-451d-80f9-de6dac26dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.882985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758930a7-d010-451d-80f9-de6dac26dd06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.883932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758930a7-d010-451d-80f9-de6dac26dd06 None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=25606976e6fe4daf9a552368088cdef1) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:11.884406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758930a7-d010-451d-80f9-de6dac26dd06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:11.886049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758930a7-d010-451d-80f9-de6dac26dd06 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:11.901513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 357/698] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:11 2022] GET /identity/v3/role_assignments?user.id=25606976e6fe4daf9a552368088cdef1&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:11.903036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5363d1-91ef-4069-96d6-5e0afd90b4d7 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.903404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5363d1-91ef-4069-96d6-5e0afd90b4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.903808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5363d1-91ef-4069-96d6-5e0afd90b4d7 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.909611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 358/699] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:11.920462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817721-fc93-4f04-a844-ad5b50c4e2be None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:11.920938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817721-fc93-4f04-a844-ad5b50c4e2be None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:11.921322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d817721-fc93-4f04-a844-ad5b50c4e2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:11.950458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2d817721-fc93-4f04-a844-ad5b50c4e2be None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:11.951799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2d817721-fc93-4f04-a844-ad5b50c4e2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:11.959284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:11.986262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 342/700] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 09:28:11.986596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:11.993678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de59e8-75d2-47ae-9377-ce840475feac None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.088384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 359/701] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:12.090102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6763-bafb-4152-9e41-1a3510d56f62 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.090815 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6763-bafb-4152-9e41-1a3510d56f62 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.091171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c6763-bafb-4152-9e41-1a3510d56f62 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.093678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 360/702] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:12.098709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f822c5-afef-4680-a1e4-d76bf1f2981a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.099032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f822c5-afef-4680-a1e4-d76bf1f2981a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.099318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f822c5-afef-4680-a1e4-d76bf1f2981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.126068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-52f822c5-afef-4680-a1e4-d76bf1f2981a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:12.128039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-52f822c5-afef-4680-a1e4-d76bf1f2981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:12.144632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de59e8-75d2-47ae-9377-ce840475feac None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:12.193571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e15ea-6d41-407b-8912-1b347447ad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:12.194423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e15ea-6d41-407b-8912-1b347447ad95 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.194720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e15ea-6d41-407b-8912-1b347447ad95 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.195045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e15ea-6d41-407b-8912-1b347447ad95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.205320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 361/703] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:28:12.207201 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f822c5-afef-4680-a1e4-d76bf1f2981a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.207670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e15ea-6d41-407b-8912-1b347447ad95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:12.209145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3e15ea-6d41-407b-8912-1b347447ad95 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-fb3e15ea-6d41-407b-8912-1b347447ad95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:12.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:12.232057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:12.233414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:12.233414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:12.233414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:12.233414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:12.233414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 343/704] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:12.233703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e15ea-6d41-407b-8912-1b347447ad95 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.273570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:12.309427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:12.334676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f822c5-afef-4680-a1e4-d76bf1f2981a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:12.369872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e15ea-6d41-407b-8912-1b347447ad95 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:12.381618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc701f5-d4eb-48d3-94d6-be056018c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:12.382750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc701f5-d4eb-48d3-94d6-be056018c0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.383285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc701f5-d4eb-48d3-94d6-be056018c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.383765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc701f5-d4eb-48d3-94d6-be056018c0e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.384635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc701f5-d4eb-48d3-94d6-be056018c0e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:12.386216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc701f5-d4eb-48d3-94d6-be056018c0e5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-6bc701f5-d4eb-48d3-94d6-be056018c0e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:12.401034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:12.402006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 09:28:12.402869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:12.406322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 362/705] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Jun 24 09:28:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:12.407405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc701f5-d4eb-48d3-94d6-be056018c0e5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.412141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540517f1-33af-49e5-8126-30152149fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:12.413012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540517f1-33af-49e5-8126-30152149fc58 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.413300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540517f1-33af-49e5-8126-30152149fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.413583 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540517f1-33af-49e5-8126-30152149fc58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.425511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540517f1-33af-49e5-8126-30152149fc58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:12.427021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540517f1-33af-49e5-8126-30152149fc58 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-540517f1-33af-49e5-8126-30152149fc58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:12.446635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:12.453749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:12.454704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:12.454704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:12.454704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:12.454704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:12.454704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 344/706] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:12.454704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540517f1-33af-49e5-8126-30152149fc58 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.521485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc701f5-d4eb-48d3-94d6-be056018c0e5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:12.547357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:12.559645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868774-98cb-4242-8963-658763d7c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:12.561031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868774-98cb-4242-8963-658763d7c076 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.561320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868774-98cb-4242-8963-658763d7c076 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.561601 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da868774-98cb-4242-8963-658763d7c076 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.562359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868774-98cb-4242-8963-658763d7c076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:12.562669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868774-98cb-4242-8963-658763d7c076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:12.564102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da868774-98cb-4242-8963-658763d7c076 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:12.571923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540517f1-33af-49e5-8126-30152149fc58 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:12.582060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 363/707] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:12.582060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868774-98cb-4242-8963-658763d7c076 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.582940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:12.621376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc29266-a959-4811-ace0-e4d37fdc84f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:12.622436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc29266-a959-4811-ace0-e4d37fdc84f0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.622989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc29266-a959-4811-ace0-e4d37fdc84f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.623492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc29266-a959-4811-ace0-e4d37fdc84f0 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.624502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc29266-a959-4811-ace0-e4d37fdc84f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:12.625016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc29266-a959-4811-ace0-e4d37fdc84f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:12.626605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc29266-a959-4811-ace0-e4d37fdc84f0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:12.638473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 345/708] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 09:28:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:12.638473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc29266-a959-4811-ace0-e4d37fdc84f0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.695218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da868774-98cb-4242-8963-658763d7c076 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:12.732567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbe664-0b3e-483b-bbc2-caa4a4149f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:12.733437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe664-0b3e-483b-bbc2-caa4a4149f98 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.733843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe664-0b3e-483b-bbc2-caa4a4149f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.734224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbe664-0b3e-483b-bbc2-caa4a4149f98 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.735365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe664-0b3e-483b-bbc2-caa4a4149f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:12.735779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe664-0b3e-483b-bbc2-caa4a4149f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:12.737387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbe664-0b3e-483b-bbc2-caa4a4149f98 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:12.754931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 364/709] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:12.755971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbe664-0b3e-483b-bbc2-caa4a4149f98 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.769870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc29266-a959-4811-ace0-e4d37fdc84f0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:12.815938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47fad-b7bb-4864-bc22-12f2bb95c04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:12.817293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47fad-b7bb-4864-bc22-12f2bb95c04f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.818060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47fad-b7bb-4864-bc22-12f2bb95c04f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.818671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb47fad-b7bb-4864-bc22-12f2bb95c04f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.823304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:12.827346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb47fad-b7bb-4864-bc22-12f2bb95c04f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:12.829365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb47fad-b7bb-4864-bc22-12f2bb95c04f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-beb47fad-b7bb-4864-bc22-12f2bb95c04f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:12.844568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:12.845519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:12.846471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:12.846471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:12.846471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:12.846471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:12.846471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:12.846471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:12.846471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:12.846471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:12.850980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 346/710] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:12.852238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47fad-b7bb-4864-bc22-12f2bb95c04f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.863357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:12.871364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbe664-0b3e-483b-bbc2-caa4a4149f98 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:12.920651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc258e4-81f2-4ac4-bcc3-e2d569240e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:12.921968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc258e4-81f2-4ac4-bcc3-e2d569240e26 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:12.922695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc258e4-81f2-4ac4-bcc3-e2d569240e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:12.923146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc258e4-81f2-4ac4-bcc3-e2d569240e26 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:12.924001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc258e4-81f2-4ac4-bcc3-e2d569240e26 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:12.925145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc258e4-81f2-4ac4-bcc3-e2d569240e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:12.927744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc258e4-81f2-4ac4-bcc3-e2d569240e26 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:12.935750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 365/711] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 09:28:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:12.936821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc258e4-81f2-4ac4-bcc3-e2d569240e26 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:12.996517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb47fad-b7bb-4864-bc22-12f2bb95c04f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:13.060067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86e57c-a118-4735-a817-88bf60d5141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:13.061780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86e57c-a118-4735-a817-88bf60d5141c None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:13.062252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86e57c-a118-4735-a817-88bf60d5141c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:13.062954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86e57c-a118-4735-a817-88bf60d5141c None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:13.064346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86e57c-a118-4735-a817-88bf60d5141c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:13.067286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86e57c-a118-4735-a817-88bf60d5141c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:13.067660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc258e4-81f2-4ac4-bcc3-e2d569240e26 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:13.099362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:13.108054 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43df642-b583-4ba4-842e-b76763cbd443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:13.108742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43df642-b583-4ba4-842e-b76763cbd443 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:13.109028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43df642-b583-4ba4-842e-b76763cbd443 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:13.109563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43df642-b583-4ba4-842e-b76763cbd443 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:13.110361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43df642-b583-4ba4-842e-b76763cbd443 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:13.110676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43df642-b583-4ba4-842e-b76763cbd443 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:13.112799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43df642-b583-4ba4-842e-b76763cbd443 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:13.126084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 366/712] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:13.127183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff219fc-11bd-49c1-8422-3c2a77c2ef1e None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:13.128114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff219fc-11bd-49c1-8422-3c2a77c2ef1e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:13.128400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff219fc-11bd-49c1-8422-3c2a77c2ef1e None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:13.129804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 367/713] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:13.132472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff219fc-11bd-49c1-8422-3c2a77c2ef1e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:13.152489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 347/714] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:28:12 2022] POST /identity/v3/users => generated 254 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:13.154954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b700b8-d089-4699-8b14-9a47903249d9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:13.154954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b700b8-d089-4699-8b14-9a47903249d9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:13.154954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b700b8-d089-4699-8b14-9a47903249d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:13.193162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c7b700b8-d089-4699-8b14-9a47903249d9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:13.194441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c7b700b8-d089-4699-8b14-9a47903249d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:13.311710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:13.329030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff219fc-11bd-49c1-8422-3c2a77c2ef1e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:13.336704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 348/715] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:13.366063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b700b8-d089-4699-8b14-9a47903249d9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:13.391135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617182e3-bebf-478c-b494-5ce96e117b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:13.391808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617182e3-bebf-478c-b494-5ce96e117b2f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:13.392096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617182e3-bebf-478c-b494-5ce96e117b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:13.392376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617182e3-bebf-478c-b494-5ce96e117b2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:13.393255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617182e3-bebf-478c-b494-5ce96e117b2f None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=0ec77816151b45228e087023588839da, user.id=0422e6863c7147b79ea4d194e6e07154) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:13.393570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617182e3-bebf-478c-b494-5ce96e117b2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:13.395049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617182e3-bebf-478c-b494-5ce96e117b2f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:13.401585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 368/716] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:13 2022] GET /identity/v3/role_assignments?user.id=0422e6863c7147b79ea4d194e6e07154&scope.project.id=0ec77816151b45228e087023588839da&role.id=9312183c32b04118985c8316f33f3830 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:13.503968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b700b8-d089-4699-8b14-9a47903249d9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:13.557615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308147b-ac45-4c1b-8da2-0a2720aa83ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:13.558445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308147b-ac45-4c1b-8da2-0a2720aa83ba None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:13.558755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308147b-ac45-4c1b-8da2-0a2720aa83ba None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:13.559089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308147b-ac45-4c1b-8da2-0a2720aa83ba None admin] PATH_INFO: `/v3/services/network` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:13.559755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308147b-ac45-4c1b-8da2-0a2720aa83ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:13.561156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308147b-ac45-4c1b-8da2-0a2720aa83ba None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c308147b-ac45-4c1b-8da2-0a2720aa83ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:13.597077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:13.598079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:13.598968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 349/717] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:13 2022] GET /identity/v3/services/network => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:13.607338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617182e3-bebf-478c-b494-5ce96e117b2f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:13.670176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:13.729708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617182e3-bebf-478c-b494-5ce96e117b2f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:13.771771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a66a1b-0f03-4625-9486-787dad6b8f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:13.772456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a66a1b-0f03-4625-9486-787dad6b8f9d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:13.772744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a66a1b-0f03-4625-9486-787dad6b8f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:13.773025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a66a1b-0f03-4625-9486-787dad6b8f9d None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:13.773744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a66a1b-0f03-4625-9486-787dad6b8f9d None admin] RBAC: Adding query filter params (name=network) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:13.774055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a66a1b-0f03-4625-9486-787dad6b8f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:13.775474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a66a1b-0f03-4625-9486-787dad6b8f9d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:13.783253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 369/718] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:13.789285 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308147b-ac45-4c1b-8da2-0a2720aa83ba None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:13.877298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:13.937640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308147b-ac45-4c1b-8da2-0a2720aa83ba None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:13.982633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b95336-2ffd-4133-bdf1-0cd80d74bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:13.983331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b95336-2ffd-4133-bdf1-0cd80d74bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:13.983621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b95336-2ffd-4133-bdf1-0cd80d74bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:13.983902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b95336-2ffd-4133-bdf1-0cd80d74bfa0 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:13.984862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b95336-2ffd-4133-bdf1-0cd80d74bfa0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:13.985173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b95336-2ffd-4133-bdf1-0cd80d74bfa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:13.986563 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b95336-2ffd-4133-bdf1-0cd80d74bfa0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:13.995696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 350/719] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:14.425813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c2ae5-a2cf-4adb-8f99-f5ac69ad3878 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:14.426525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c2ae5-a2cf-4adb-8f99-f5ac69ad3878 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:14.427065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c2ae5-a2cf-4adb-8f99-f5ac69ad3878 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:14.428918 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 370/720] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:14.433926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a2a0c-ccc5-4185-9364-2900a01c3983 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:14.434220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a2a0c-ccc5-4185-9364-2900a01c3983 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:14.434504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a2a0c-ccc5-4185-9364-2900a01c3983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:14.459820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4d5a2a0c-ccc5-4185-9364-2900a01c3983 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:14.461031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4d5a2a0c-ccc5-4185-9364-2900a01c3983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:14.561573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 351/721] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:14.610659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c2ae5-a2cf-4adb-8f99-f5ac69ad3878 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:14.776674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c2ae5-a2cf-4adb-8f99-f5ac69ad3878 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:14.797320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:14.827758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256785bd-1293-4f6b-8e62-eaa123406316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:14.828571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256785bd-1293-4f6b-8e62-eaa123406316 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:14.828865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256785bd-1293-4f6b-8e62-eaa123406316 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:14.829175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256785bd-1293-4f6b-8e62-eaa123406316 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:14.851804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256785bd-1293-4f6b-8e62-eaa123406316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-256785bd-1293-4f6b-8e62-eaa123406316 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:14.859945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:14.860871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:14.861714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 371/722] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:14.867541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a2a0c-ccc5-4185-9364-2900a01c3983 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:14.958965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:15.035374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a2a0c-ccc5-4185-9364-2900a01c3983 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:15.092934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3fab0-33ec-4ce4-a140-365a9b06ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:15.093611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3fab0-33ec-4ce4-a140-365a9b06ce5a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.093896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3fab0-33ec-4ce4-a140-365a9b06ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.094173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3fab0-33ec-4ce4-a140-365a9b06ce5a None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.094947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3fab0-33ec-4ce4-a140-365a9b06ce5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:15.095257 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3fab0-33ec-4ce4-a140-365a9b06ce5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:15.097446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3fab0-33ec-4ce4-a140-365a9b06ce5a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:15.110957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 352/723] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:15.116733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256785bd-1293-4f6b-8e62-eaa123406316 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:15.275968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256785bd-1293-4f6b-8e62-eaa123406316 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:15.309985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e122eb32-d699-4510-81e7-e6086d539107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:15.310711 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122eb32-d699-4510-81e7-e6086d539107 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.311091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122eb32-d699-4510-81e7-e6086d539107 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.311451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e122eb32-d699-4510-81e7-e6086d539107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.322367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122eb32-d699-4510-81e7-e6086d539107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:15.323842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e122eb32-d699-4510-81e7-e6086d539107 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e122eb32-d699-4510-81e7-e6086d539107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:15.341723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:15.342727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:15.343797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:15.343797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:15.343797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:15.343797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:15.343797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 372/724] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:15.349115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3fab0-33ec-4ce4-a140-365a9b06ce5a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:15.369265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23dd76-f48a-49d2-8110-a82011f7139e None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.369591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23dd76-f48a-49d2-8110-a82011f7139e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.369833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23dd76-f48a-49d2-8110-a82011f7139e None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.371559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 373/725] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:28:15.378196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6233-7376-4cc0-b0d1-d4bb2394ca4c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.378487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6233-7376-4cc0-b0d1-d4bb2394ca4c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.378770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b6233-7376-4cc0-b0d1-d4bb2394ca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.398660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2c0b6233-7376-4cc0-b0d1-d4bb2394ca4c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:15.401842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2c0b6233-7376-4cc0-b0d1-d4bb2394ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:15.451209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:15.484819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3fab0-33ec-4ce4-a140-365a9b06ce5a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:15.499689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:15.522371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff597a92-2c20-4cc4-8862-00d9977ba050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:15.523441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff597a92-2c20-4cc4-8862-00d9977ba050 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.523934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff597a92-2c20-4cc4-8862-00d9977ba050 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.524443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff597a92-2c20-4cc4-8862-00d9977ba050 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.525401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff597a92-2c20-4cc4-8862-00d9977ba050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:15.525924 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff597a92-2c20-4cc4-8862-00d9977ba050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:15.527696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff597a92-2c20-4cc4-8862-00d9977ba050 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:15.542565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 374/726] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:28:15.548120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 353/727] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:15.558195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b6233-7376-4cc0-b0d1-d4bb2394ca4c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:15.569277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff597a92-2c20-4cc4-8862-00d9977ba050 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:15.722121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff597a92-2c20-4cc4-8862-00d9977ba050 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:15.762819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b6233-7376-4cc0-b0d1-d4bb2394ca4c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:15.787653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15682f91-8e18-44b1-8cdd-c838efa1e723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:15.788445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682f91-8e18-44b1-8cdd-c838efa1e723 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.788738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682f91-8e18-44b1-8cdd-c838efa1e723 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.789082 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15682f91-8e18-44b1-8cdd-c838efa1e723 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.789757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15682f91-8e18-44b1-8cdd-c838efa1e723 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:15.791190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15682f91-8e18-44b1-8cdd-c838efa1e723 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:15.804338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e545e-3674-4001-960a-42145721d4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:15.805407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e545e-3674-4001-960a-42145721d4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.805961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e545e-3674-4001-960a-42145721d4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.806446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e545e-3674-4001-960a-42145721d4a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.814119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e545e-3674-4001-960a-42145721d4a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:15.816908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e545e-3674-4001-960a-42145721d4a7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-bb9e545e-3674-4001-960a-42145721d4a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:15.831479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:15.832633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:15.833792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:15.836279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 375/728] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:15.841915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e545e-3674-4001-960a-42145721d4a7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:15.863811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:15.914982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 354/729] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:28:15 2022] POST /identity/v3/services => generated 251 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:15.916900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf0b7c-7df5-4318-98b1-a5a17269d880 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.917345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf0b7c-7df5-4318-98b1-a5a17269d880 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.917808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf0b7c-7df5-4318-98b1-a5a17269d880 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.923614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 355/730] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:15.937399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390dd14-41ab-438a-acb4-59528ccad473 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.937922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390dd14-41ab-438a-acb4-59528ccad473 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.938364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390dd14-41ab-438a-acb4-59528ccad473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.961742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b390dd14-41ab-438a-acb4-59528ccad473 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:15.964744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b390dd14-41ab-438a-acb4-59528ccad473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:15.988219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e545e-3674-4001-960a-42145721d4a7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:16.020827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:16.045842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62649c7-5ca9-4598-aaad-4086a066bc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:16.047084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62649c7-5ca9-4598-aaad-4086a066bc7d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.047569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62649c7-5ca9-4598-aaad-4086a066bc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.048961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62649c7-5ca9-4598-aaad-4086a066bc7d None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.051180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62649c7-5ca9-4598-aaad-4086a066bc7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:16.051698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62649c7-5ca9-4598-aaad-4086a066bc7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:16.053379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62649c7-5ca9-4598-aaad-4086a066bc7d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:16.078978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 376/731] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 09:28:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:16.084184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62649c7-5ca9-4598-aaad-4086a066bc7d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:16.135899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 356/732] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:28:16.137484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f77b0c-d437-450d-a60b-aa580247ea7a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.137770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f77b0c-d437-450d-a60b-aa580247ea7a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.138046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f77b0c-d437-450d-a60b-aa580247ea7a None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.139853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 357/733] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:16.145473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01646c8-2f0f-4138-bf23-185f2a753591 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.145761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01646c8-2f0f-4138-bf23-185f2a753591 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.146042 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01646c8-2f0f-4138-bf23-185f2a753591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.169465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a01646c8-2f0f-4138-bf23-185f2a753591 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:16.170652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a01646c8-2f0f-4138-bf23-185f2a753591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:16.184405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:16.222704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62649c7-5ca9-4598-aaad-4086a066bc7d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:16.252925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 358/734] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 09:28:16.253795 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01646c8-2f0f-4138-bf23-185f2a753591 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:16.272073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188210d6-28b2-4283-918f-6c97ea44ab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:16.273110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188210d6-28b2-4283-918f-6c97ea44ab01 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.273618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188210d6-28b2-4283-918f-6c97ea44ab01 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.274141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188210d6-28b2-4283-918f-6c97ea44ab01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.364651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:16.367256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188210d6-28b2-4283-918f-6c97ea44ab01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:16.369521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188210d6-28b2-4283-918f-6c97ea44ab01 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:16.370255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01646c8-2f0f-4138-bf23-185f2a753591 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:16.407140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169ea7-b032-43a4-b905-7340892d2f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:16.407983 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169ea7-b032-43a4-b905-7340892d2f46 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.408266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169ea7-b032-43a4-b905-7340892d2f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.408536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12169ea7-b032-43a4-b905-7340892d2f46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.422607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12169ea7-b032-43a4-b905-7340892d2f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-12169ea7-b032-43a4-b905-7340892d2f46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:16.431145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:16.432105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:16.432953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 359/735] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:16.433679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169ea7-b032-43a4-b905-7340892d2f46 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:16.479223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:16.490171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 377/736] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:16 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 09:28:16.491155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188210d6-28b2-4283-918f-6c97ea44ab01 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:16.545614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12169ea7-b032-43a4-b905-7340892d2f46 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:16.588249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d454d2-db55-4325-8a54-de8bdd11048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:16.588621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d454d2-db55-4325-8a54-de8bdd11048c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.588924 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d454d2-db55-4325-8a54-de8bdd11048c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.589201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d454d2-db55-4325-8a54-de8bdd11048c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.601342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d454d2-db55-4325-8a54-de8bdd11048c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:16.603213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188210d6-28b2-4283-918f-6c97ea44ab01 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-70d454d2-db55-4325-8a54-de8bdd11048c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:16.609709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:16.610685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:16.611663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 360/737] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:16.614254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d454d2-db55-4325-8a54-de8bdd11048c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:16.634422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:16.643015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336de73e-62f7-4662-a6c2-dd5872305d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:16.644351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336de73e-62f7-4662-a6c2-dd5872305d1c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.644636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336de73e-62f7-4662-a6c2-dd5872305d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.644914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336de73e-62f7-4662-a6c2-dd5872305d1c None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.645733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336de73e-62f7-4662-a6c2-dd5872305d1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:16.646050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336de73e-62f7-4662-a6c2-dd5872305d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:16.647446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336de73e-62f7-4662-a6c2-dd5872305d1c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:16.656093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 378/738] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:16.656951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336de73e-62f7-4662-a6c2-dd5872305d1c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:16.696755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:16.736259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d454d2-db55-4325-8a54-de8bdd11048c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:16.768574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336de73e-62f7-4662-a6c2-dd5872305d1c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:16.773415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34820b80-2d87-41eb-8f16-54493871db01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:16.778197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34820b80-2d87-41eb-8f16-54493871db01 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.778197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34820b80-2d87-41eb-8f16-54493871db01 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.778197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34820b80-2d87-41eb-8f16-54493871db01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.786499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34820b80-2d87-41eb-8f16-54493871db01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:16.788006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34820b80-2d87-41eb-8f16-54493871db01 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:16.804550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65003e-5cac-4429-89b9-48c87d9cf40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:16.805230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65003e-5cac-4429-89b9-48c87d9cf40c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.805522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65003e-5cac-4429-89b9-48c87d9cf40c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.805806 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65003e-5cac-4429-89b9-48c87d9cf40c None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.806610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65003e-5cac-4429-89b9-48c87d9cf40c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:16.806971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65003e-5cac-4429-89b9-48c87d9cf40c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-34820b80-2d87-41eb-8f16-54493871db01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:16.807278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:16.808117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:16.809006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:16.809006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:16.809006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:16.809006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:16.809224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65003e-5cac-4429-89b9-48c87d9cf40c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:16.812904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 361/739] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:16.814150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ab812-5fb3-4567-a09c-a610dd5c7281 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.814441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ab812-5fb3-4567-a09c-a610dd5c7281 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.814722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ab812-5fb3-4567-a09c-a610dd5c7281 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.817387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 362/740] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:16.817960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ab812-5fb3-4567-a09c-a610dd5c7281 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:16.819903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 379/741] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:16.820936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65003e-5cac-4429-89b9-48c87d9cf40c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:16.894598 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:16.926802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:16.932621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65003e-5cac-4429-89b9-48c87d9cf40c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:16.937073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ab812-5fb3-4567-a09c-a610dd5c7281 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:16.969430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc464fb2-4c21-46fd-ab30-4fe6e69540c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:16.970089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464fb2-4c21-46fd-ab30-4fe6e69540c3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.970375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464fb2-4c21-46fd-ab30-4fe6e69540c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.970661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464fb2-4c21-46fd-ab30-4fe6e69540c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.972028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464fb2-4c21-46fd-ab30-4fe6e69540c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:16.972395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464fb2-4c21-46fd-ab30-4fe6e69540c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:16.973728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464fb2-4c21-46fd-ab30-4fe6e69540c3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:16.975635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266698c-276d-4105-9b71-8ff4b4793e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:16.976420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266698c-276d-4105-9b71-8ff4b4793e8f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.976702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266698c-276d-4105-9b71-8ff4b4793e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.977029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266698c-276d-4105-9b71-8ff4b4793e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.985471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 380/742] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:16.989005 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0881d34-1102-49a7-8552-695ad494832d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:16.989151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266698c-276d-4105-9b71-8ff4b4793e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:16.989587 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0881d34-1102-49a7-8552-695ad494832d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:16.990026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0881d34-1102-49a7-8552-695ad494832d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:16.990857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266698c-276d-4105-9b71-8ff4b4793e8f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.009115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d0881d34-1102-49a7-8552-695ad494832d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-4266698c-276d-4105-9b71-8ff4b4793e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:17.009307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:17.010275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:17.011280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:17.011280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:17.011280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:17.011280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:17.012595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d0881d34-1102-49a7-8552-695ad494832d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:17.015026 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 363/743] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:17.016259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266698c-276d-4105-9b71-8ff4b4793e8f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.085794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 381/744] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 09:28:17.086657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0881d34-1102-49a7-8552-695ad494832d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.134237 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266698c-276d-4105-9b71-8ff4b4793e8f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:17.153990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:17.175838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf16d-f30c-4e54-90e4-1e57c5621109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:17.176988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf16d-f30c-4e54-90e4-1e57c5621109 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:17.177281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf16d-f30c-4e54-90e4-1e57c5621109 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:17.177836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf16d-f30c-4e54-90e4-1e57c5621109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:17.183250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:17.191925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bf16d-f30c-4e54-90e4-1e57c5621109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:17.194201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bf16d-f30c-4e54-90e4-1e57c5621109 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.198499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0881d34-1102-49a7-8552-695ad494832d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-225bf16d-f30c-4e54-90e4-1e57c5621109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:17.216974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:17.217896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:17.218870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:17.218870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:17.218870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:17.218870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:17.218870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 364/745] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:17.219162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf16d-f30c-4e54-90e4-1e57c5621109 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.245643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d32b-9f15-4cab-a9b8-6ef8a5e9cd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:17.247601 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d32b-9f15-4cab-a9b8-6ef8a5e9cd24 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:17.248520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d32b-9f15-4cab-a9b8-6ef8a5e9cd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:17.249080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d32b-9f15-4cab-a9b8-6ef8a5e9cd24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:17.259524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d32b-9f15-4cab-a9b8-6ef8a5e9cd24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:17.260504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d32b-9f15-4cab-a9b8-6ef8a5e9cd24 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-f299d32b-9f15-4cab-a9b8-6ef8a5e9cd24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:17.276085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:17.277249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 382/746] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:17.278135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d32b-9f15-4cab-a9b8-6ef8a5e9cd24 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.334198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf16d-f30c-4e54-90e4-1e57c5621109 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:17.370351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2c158-c559-45b8-a094-6c98f10abc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:17.371052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2c158-c559-45b8-a094-6c98f10abc70 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:17.371339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2c158-c559-45b8-a094-6c98f10abc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:17.371624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2c158-c559-45b8-a094-6c98f10abc70 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:17.372344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2c158-c559-45b8-a094-6c98f10abc70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:17.372646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2c158-c559-45b8-a094-6c98f10abc70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:17.374026 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2c158-c559-45b8-a094-6c98f10abc70 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.386398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 365/747] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:17.388830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d32b-9f15-4cab-a9b8-6ef8a5e9cd24 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:17.391424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2c158-c559-45b8-a094-6c98f10abc70 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.420480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:17.425475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4864-8216-4ba7-bbbd-7a87d884a155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:17.426141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4864-8216-4ba7-bbbd-7a87d884a155 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:17.426430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4864-8216-4ba7-bbbd-7a87d884a155 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:17.426707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af4864-8216-4ba7-bbbd-7a87d884a155 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:17.427492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af4864-8216-4ba7-bbbd-7a87d884a155 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:17.428860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af4864-8216-4ba7-bbbd-7a87d884a155 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.492630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2c158-c559-45b8-a094-6c98f10abc70 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:17.517279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 383/748] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:28:17 2022] POST /identity/v3/services => generated 240 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:17.518414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4864-8216-4ba7-bbbd-7a87d884a155 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.533285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:17.545529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5afb0-0435-4ed4-907e-ce12f3e7125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:17.546529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5afb0-0435-4ed4-907e-ce12f3e7125f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:17.549959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5afb0-0435-4ed4-907e-ce12f3e7125f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:17.549959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5afb0-0435-4ed4-907e-ce12f3e7125f None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:17.549959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5afb0-0435-4ed4-907e-ce12f3e7125f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:17.549959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5afb0-0435-4ed4-907e-ce12f3e7125f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:17.554899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5afb0-0435-4ed4-907e-ce12f3e7125f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.576922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 366/749] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:17.576922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5afb0-0435-4ed4-907e-ce12f3e7125f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.655083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af4864-8216-4ba7-bbbd-7a87d884a155 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:17.707361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:17.707536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816591d-2858-4585-8c27-48099e4537c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:17.708066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816591d-2858-4585-8c27-48099e4537c6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:17.708382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816591d-2858-4585-8c27-48099e4537c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:17.708666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816591d-2858-4585-8c27-48099e4537c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:17.709965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816591d-2858-4585-8c27-48099e4537c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:17.710768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816591d-2858-4585-8c27-48099e4537c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:17.711779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816591d-2858-4585-8c27-48099e4537c6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.723101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5afb0-0435-4ed4-907e-ce12f3e7125f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:17.727497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 384/750] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:17.731900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816591d-2858-4585-8c27-48099e4537c6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.772217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3915e-cb3b-4415-8d37-5e4f65b8df50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:17.773365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3915e-cb3b-4415-8d37-5e4f65b8df50 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:17.773666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3915e-cb3b-4415-8d37-5e4f65b8df50 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:17.773947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3915e-cb3b-4415-8d37-5e4f65b8df50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:17.781676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3915e-cb3b-4415-8d37-5e4f65b8df50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:17.783163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3915e-cb3b-4415-8d37-5e4f65b8df50 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e2b3915e-cb3b-4415-8d37-5e4f65b8df50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:17.800421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:17.801482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:17.802402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 367/751] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:17.803047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3915e-cb3b-4415-8d37-5e4f65b8df50 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.817800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:17.855622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816591d-2858-4585-8c27-48099e4537c6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:17.894244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e535-db11-46ce-a263-7cd30bd73cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:17.895346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e535-db11-46ce-a263-7cd30bd73cad None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:17.895810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e535-db11-46ce-a263-7cd30bd73cad None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:17.896239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41e535-db11-46ce-a263-7cd30bd73cad None admin] PATH_INFO: `/v3/users/nova` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:17.903940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41e535-db11-46ce-a263-7cd30bd73cad None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:17.905648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41e535-db11-46ce-a263-7cd30bd73cad None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.907863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3915e-cb3b-4415-8d37-5e4f65b8df50 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-9e41e535-db11-46ce-a263-7cd30bd73cad None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:17.922698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:17.923825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:17.925375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:17.928105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 385/752] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:17.929186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e535-db11-46ce-a263-7cd30bd73cad None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:17.950306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5dfd2-374f-4350-9e44-4d77c833c1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:17.951026 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5dfd2-374f-4350-9e44-4d77c833c1ea None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:17.951289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5dfd2-374f-4350-9e44-4d77c833c1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:17.951571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a5dfd2-374f-4350-9e44-4d77c833c1ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:17.952424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5dfd2-374f-4350-9e44-4d77c833c1ea None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=0ec77816151b45228e087023588839da, user.id=25606976e6fe4daf9a552368088cdef1) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:17.952778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5dfd2-374f-4350-9e44-4d77c833c1ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:17.954405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a5dfd2-374f-4350-9e44-4d77c833c1ea None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:17.962306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 368/753] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/role_assignments?user.id=25606976e6fe4daf9a552368088cdef1&scope.project.id=0ec77816151b45228e087023588839da&role.id=9312183c32b04118985c8316f33f3830 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:17.963363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5dfd2-374f-4350-9e44-4d77c833c1ea None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:18.007177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:18.093597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a5dfd2-374f-4350-9e44-4d77c833c1ea None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:18.134679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f9482-a187-43c2-ab13-3705adeba8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:18.135416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f9482-a187-43c2-ab13-3705adeba8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:18.135686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f9482-a187-43c2-ab13-3705adeba8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:18.136330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f9482-a187-43c2-ab13-3705adeba8f3 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:18.137478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f9482-a187-43c2-ab13-3705adeba8f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:18.137799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f9482-a187-43c2-ab13-3705adeba8f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:18.139317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f9482-a187-43c2-ab13-3705adeba8f3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:18.139840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41e535-db11-46ce-a263-7cd30bd73cad None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:18.165864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 369/754] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:18.167322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f9482-a187-43c2-ab13-3705adeba8f3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:18.241526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:18.252289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb3d50-ccad-4d1d-a84c-1ab55baebe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:18.253479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3d50-ccad-4d1d-a84c-1ab55baebe8c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:18.253830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3d50-ccad-4d1d-a84c-1ab55baebe8c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:18.254221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb3d50-ccad-4d1d-a84c-1ab55baebe8c None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:18.257215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb3d50-ccad-4d1d-a84c-1ab55baebe8c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:18.257349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:18.257455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb3d50-ccad-4d1d-a84c-1ab55baebe8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:18.257455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb3d50-ccad-4d1d-a84c-1ab55baebe8c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:18.277929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 386/755] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 09:28:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:18.279420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97fe7-361a-4796-b079-573549747451 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:18.279817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97fe7-361a-4796-b079-573549747451 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:18.280242 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97fe7-361a-4796-b079-573549747451 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:18.286810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f9482-a187-43c2-ab13-3705adeba8f3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:18.287156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 387/756] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:18.288041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f97fe7-361a-4796-b079-573549747451 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:18.334821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce82d85-2e35-438b-8a68-f4986515e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:18.336085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce82d85-2e35-438b-8a68-f4986515e786 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:18.336370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce82d85-2e35-438b-8a68-f4986515e786 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:18.336969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce82d85-2e35-438b-8a68-f4986515e786 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:18.351824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce82d85-2e35-438b-8a68-f4986515e786 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:18.353798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce82d85-2e35-438b-8a68-f4986515e786 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-4ce82d85-2e35-438b-8a68-f4986515e786 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:18.378755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:18.379753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:18.380741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:18.380741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:18.380741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:18.380741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:18.382945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 370/757] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:18.384332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f400cc-91bd-451f-a952-156743d4bfd8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:18.384713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f400cc-91bd-451f-a952-156743d4bfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:18.385085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f400cc-91bd-451f-a952-156743d4bfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:18.402061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f97fe7-361a-4796-b079-573549747451 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:18.407095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-88f400cc-91bd-451f-a952-156743d4bfd8 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:18.408294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-88f400cc-91bd-451f-a952-156743d4bfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:18.446164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b45e94-f23f-4e9b-b56e-8f3b84c68e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:18.446928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b45e94-f23f-4e9b-b56e-8f3b84c68e02 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:18.447220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b45e94-f23f-4e9b-b56e-8f3b84c68e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:18.447504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b45e94-f23f-4e9b-b56e-8f3b84c68e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:18.499311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 371/758] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:18.500225 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f400cc-91bd-451f-a952-156743d4bfd8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:18.508059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:18.527353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b45e94-f23f-4e9b-b56e-8f3b84c68e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:18.529515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b45e94-f23f-4e9b-b56e-8f3b84c68e02 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:18.574408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:18.646882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f400cc-91bd-451f-a952-156743d4bfd8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:18.647846 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 388/759] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:28:18.648702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b45e94-f23f-4e9b-b56e-8f3b84c68e02 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:18.685251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974b7b1-734a-48a4-8471-633eed6e6620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:18.686010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974b7b1-734a-48a4-8471-633eed6e6620 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:18.686202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974b7b1-734a-48a4-8471-633eed6e6620 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:18.686459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974b7b1-734a-48a4-8471-633eed6e6620 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:18.687209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974b7b1-734a-48a4-8471-633eed6e6620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:18.687583 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974b7b1-734a-48a4-8471-633eed6e6620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:18.688992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974b7b1-734a-48a4-8471-633eed6e6620 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:18.706884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 372/760] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:18.706884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974b7b1-734a-48a4-8471-633eed6e6620 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:18.763561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:18.785370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b45e94-f23f-4e9b-b56e-8f3b84c68e02 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:18.833212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031f392-4691-4014-af68-b3302edb4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:18.835170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f392-4691-4014-af68-b3302edb4d16 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:18.835467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f392-4691-4014-af68-b3302edb4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:18.835746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031f392-4691-4014-af68-b3302edb4d16 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:18.836409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031f392-4691-4014-af68-b3302edb4d16 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:18.837804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031f392-4691-4014-af68-b3302edb4d16 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:18.841387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974b7b1-734a-48a4-8471-633eed6e6620 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:18.852162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-b031f392-4691-4014-af68-b3302edb4d16 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:18.855135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:18.856090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 09:28:18.856927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:18.860650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 389/761] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Jun 24 09:28:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:18.861678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031f392-4691-4014-af68-b3302edb4d16 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:18.886401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1dac7-f895-4282-bd0a-c0e534ba5e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:18.888272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1dac7-f895-4282-bd0a-c0e534ba5e8e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:18.888888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1dac7-f895-4282-bd0a-c0e534ba5e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:18.890390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1dac7-f895-4282-bd0a-c0e534ba5e8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:18.903815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1dac7-f895-4282-bd0a-c0e534ba5e8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:18.905692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1dac7-f895-4282-bd0a-c0e534ba5e8e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-81b1dac7-f895-4282-bd0a-c0e534ba5e8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:18.925075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:18.926138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:18.927036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:18.927036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:18.927036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:18.927036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:18.933716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 373/762] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:18.934876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1dac7-f895-4282-bd0a-c0e534ba5e8e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:18.978654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031f392-4691-4014-af68-b3302edb4d16 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.013097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64ed2b-e18b-4cf0-8c64-b3628f6d7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.014115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64ed2b-e18b-4cf0-8c64-b3628f6d7dba None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.014408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64ed2b-e18b-4cf0-8c64-b3628f6d7dba None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.014760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64ed2b-e18b-4cf0-8c64-b3628f6d7dba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.022257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64ed2b-e18b-4cf0-8c64-b3628f6d7dba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.023826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc64ed2b-e18b-4cf0-8c64-b3628f6d7dba None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-fc64ed2b-e18b-4cf0-8c64-b3628f6d7dba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:19.039171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:19.040045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:19.040941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:19.040941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:19.040941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:19.040941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:19.040941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:19.040941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:19.040941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:19.040941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:19.045074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 390/763] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:19.045898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64ed2b-e18b-4cf0-8c64-b3628f6d7dba None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:19.048609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1dac7-f895-4282-bd0a-c0e534ba5e8e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.057303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:19.087408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c535ea-97b8-4523-80ac-1567333fe1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.088446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c535ea-97b8-4523-80ac-1567333fe1bc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.088933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c535ea-97b8-4523-80ac-1567333fe1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.089423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c535ea-97b8-4523-80ac-1567333fe1bc None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.090330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c535ea-97b8-4523-80ac-1567333fe1bc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:19.090834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c535ea-97b8-4523-80ac-1567333fe1bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.092823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c535ea-97b8-4523-80ac-1567333fe1bc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.098716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 374/764] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 09:28:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:19.100216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c535ea-97b8-4523-80ac-1567333fe1bc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:19.128725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:19.155810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc64ed2b-e18b-4cf0-8c64-b3628f6d7dba None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.194523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625a14-1616-477e-ae01-26702d0fd835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.195199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625a14-1616-477e-ae01-26702d0fd835 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.195488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625a14-1616-477e-ae01-26702d0fd835 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.195766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a625a14-1616-477e-ae01-26702d0fd835 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.196494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a625a14-1616-477e-ae01-26702d0fd835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:19.196800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a625a14-1616-477e-ae01-26702d0fd835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.198415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a625a14-1616-477e-ae01-26702d0fd835 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.215086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 391/765] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:19.215086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625a14-1616-477e-ae01-26702d0fd835 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:19.219596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c535ea-97b8-4523-80ac-1567333fe1bc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.258316 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09a67-b302-422e-b897-a60aa6f4f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.259529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09a67-b302-422e-b897-a60aa6f4f353 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.260019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09a67-b302-422e-b897-a60aa6f4f353 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.260546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb09a67-b302-422e-b897-a60aa6f4f353 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.261527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb09a67-b302-422e-b897-a60aa6f4f353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:19.262101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb09a67-b302-422e-b897-a60aa6f4f353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.263917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb09a67-b302-422e-b897-a60aa6f4f353 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.277212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 375/766] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:19.278290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09a67-b302-422e-b897-a60aa6f4f353 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:19.289541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:19.331157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a625a14-1616-477e-ae01-26702d0fd835 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.375537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507936ea-acd3-45d9-82f0-ec90f19297aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.378645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507936ea-acd3-45d9-82f0-ec90f19297aa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.380864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507936ea-acd3-45d9-82f0-ec90f19297aa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.381162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507936ea-acd3-45d9-82f0-ec90f19297aa None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.381890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507936ea-acd3-45d9-82f0-ec90f19297aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:19.382208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507936ea-acd3-45d9-82f0-ec90f19297aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.383724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507936ea-acd3-45d9-82f0-ec90f19297aa None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.389711 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:19.389850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 392/767] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 09:28:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:19.391413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507936ea-acd3-45d9-82f0-ec90f19297aa None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:19.407943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb09a67-b302-422e-b897-a60aa6f4f353 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.446536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6ee8e-cab1-4a13-87e9-19f6e965f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.447743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6ee8e-cab1-4a13-87e9-19f6e965f045 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.448230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6ee8e-cab1-4a13-87e9-19f6e965f045 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.448760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6ee8e-cab1-4a13-87e9-19f6e965f045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.457348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6ee8e-cab1-4a13-87e9-19f6e965f045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.459182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6ee8e-cab1-4a13-87e9-19f6e965f045 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-feb6ee8e-cab1-4a13-87e9-19f6e965f045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:19.475353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:19.476286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:19.477151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:19.477151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:19.477151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:19.477151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:19.477151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:19.477151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:19.477151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:19.477151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:19.484286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 376/768] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:19.485764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6ee8e-cab1-4a13-87e9-19f6e965f045 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:19.505400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507936ea-acd3-45d9-82f0-ec90f19297aa None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.537529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:19.542676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4488d8-103d-4bf8-b27a-081b8f6b7e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.543577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4488d8-103d-4bf8-b27a-081b8f6b7e99 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.544074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4488d8-103d-4bf8-b27a-081b8f6b7e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.546234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4488d8-103d-4bf8-b27a-081b8f6b7e99 None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/0422e6863c7147b79ea4d194e6e07154/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.546234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4488d8-103d-4bf8-b27a-081b8f6b7e99 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=0422e6863c7147b79ea4d194e6e07154, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.547745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4488d8-103d-4bf8-b27a-081b8f6b7e99 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.605223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6ee8e-cab1-4a13-87e9-19f6e965f045 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.615694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 393/769] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:19 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/0422e6863c7147b79ea4d194e6e07154/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:19.616802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4488d8-103d-4bf8-b27a-081b8f6b7e99 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:19.679042 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c42487-e695-4033-b891-98d73acece95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.679732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42487-e695-4033-b891-98d73acece95 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.680019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42487-e695-4033-b891-98d73acece95 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.680949 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42487-e695-4033-b891-98d73acece95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.681080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c42487-e695-4033-b891-98d73acece95 None admin] RBAC: Adding query filter params (interface=public, service_id=4389e5adba434eac8fd3022d58c6c322, region_id=RegionOne) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:19.681417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c42487-e695-4033-b891-98d73acece95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.686160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c42487-e695-4033-b891-98d73acece95 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.709367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 377/770] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 09:28:19 2022] GET /identity/v3/endpoints?service_id=4389e5adba434eac8fd3022d58c6c322&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:19.715081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c42487-e695-4033-b891-98d73acece95 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:19.727496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:19.794023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4488d8-103d-4bf8-b27a-081b8f6b7e99 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.836120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd164e4b-1959-481a-93cc-49333fcbfb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.837457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164e4b-1959-481a-93cc-49333fcbfb15 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.837907 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164e4b-1959-481a-93cc-49333fcbfb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.838257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164e4b-1959-481a-93cc-49333fcbfb15 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.839141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c42487-e695-4033-b891-98d73acece95 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:19.839254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164e4b-1959-481a-93cc-49333fcbfb15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:19.839590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164e4b-1959-481a-93cc-49333fcbfb15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.841279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164e4b-1959-481a-93cc-49333fcbfb15 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.856998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 394/771] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:19.858258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed18b4-61b6-4c8e-971d-c164b3604294 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.858556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed18b4-61b6-4c8e-971d-c164b3604294 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.858833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed18b4-61b6-4c8e-971d-c164b3604294 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.861543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 395/772] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:19.874827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dabe1-a1ab-44ca-9dda-27dcf26ccf6b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.874827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dabe1-a1ab-44ca-9dda-27dcf26ccf6b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.874827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dabe1-a1ab-44ca-9dda-27dcf26ccf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.893693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f755fe-e133-4d56-844e-614d828e2bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:19.894870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f755fe-e133-4d56-844e-614d828e2bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:19.894870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f755fe-e133-4d56-844e-614d828e2bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:19.895065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f755fe-e133-4d56-844e-614d828e2bb5 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:19.895675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f755fe-e133-4d56-844e-614d828e2bb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:19.896847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-989dabe1-a1ab-44ca-9dda-27dcf26ccf6b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:19.897121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f755fe-e133-4d56-844e-614d828e2bb5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:19.898051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-989dabe1-a1ab-44ca-9dda-27dcf26ccf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:19.903365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 378/773] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 09:28:19 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:19.903993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f755fe-e133-4d56-844e-614d828e2bb5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:19.987982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:20.032847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:20.049687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f755fe-e133-4d56-844e-614d828e2bb5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:20.076570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 396/774] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:20.107569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3080e5-688e-40c3-9080-5d6b71c14ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:20.108231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3080e5-688e-40c3-9080-5d6b71c14ccb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:20.108515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3080e5-688e-40c3-9080-5d6b71c14ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:20.108794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3080e5-688e-40c3-9080-5d6b71c14ccb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:20.109881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3080e5-688e-40c3-9080-5d6b71c14ccb None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=2a5fd14de7794b14bd0a2a2a62a70762) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:20.110194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3080e5-688e-40c3-9080-5d6b71c14ccb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:20.111689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3080e5-688e-40c3-9080-5d6b71c14ccb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:20.118767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 379/775] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:19 2022] GET /identity/v3/role_assignments?user.id=2a5fd14de7794b14bd0a2a2a62a70762&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:20.126353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dabe1-a1ab-44ca-9dda-27dcf26ccf6b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:20.158739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d0f33-1809-4aff-8387-529a9f731fb6 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:20.159118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d0f33-1809-4aff-8387-529a9f731fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:20.159344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d0f33-1809-4aff-8387-529a9f731fb6 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:20.163794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 380/776] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:20.172057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d83187-480a-4214-8bd5-06213bcf8e89 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:20.172361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d83187-480a-4214-8bd5-06213bcf8e89 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:20.172622 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d83187-480a-4214-8bd5-06213bcf8e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:20.210275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-57d83187-480a-4214-8bd5-06213bcf8e89 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:20.211572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-57d83187-480a-4214-8bd5-06213bcf8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:20.317533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dabe1-a1ab-44ca-9dda-27dcf26ccf6b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:20.342971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 381/777] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:20.359341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac544aa6-309f-4ddf-aaf8-5eb473a7a83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:20.360399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac544aa6-309f-4ddf-aaf8-5eb473a7a83a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:20.360683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac544aa6-309f-4ddf-aaf8-5eb473a7a83a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:20.360960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac544aa6-309f-4ddf-aaf8-5eb473a7a83a None admin] PATH_INFO: `/v3/services/network` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:20.361706 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac544aa6-309f-4ddf-aaf8-5eb473a7a83a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:20.363742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac544aa6-309f-4ddf-aaf8-5eb473a7a83a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:20.368283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d83187-480a-4214-8bd5-06213bcf8e89 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ac544aa6-309f-4ddf-aaf8-5eb473a7a83a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:20.377194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:20.378613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:20.379463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 397/778] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:20 2022] GET /identity/v3/services/network => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:20.384599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac544aa6-309f-4ddf-aaf8-5eb473a7a83a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:20.440026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:20.501624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac544aa6-309f-4ddf-aaf8-5eb473a7a83a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:20.527678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:20.545037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e50d2-42fd-44f2-abf7-4ff5fd0e3040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:20.545710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e50d2-42fd-44f2-abf7-4ff5fd0e3040 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:20.545992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e50d2-42fd-44f2-abf7-4ff5fd0e3040 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:20.546267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e50d2-42fd-44f2-abf7-4ff5fd0e3040 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:20.547000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e50d2-42fd-44f2-abf7-4ff5fd0e3040 None admin] RBAC: Adding query filter params (name=network) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:20.547306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e50d2-42fd-44f2-abf7-4ff5fd0e3040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:20.550868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e50d2-42fd-44f2-abf7-4ff5fd0e3040 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:20.555352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 398/779] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:20.561260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e50d2-42fd-44f2-abf7-4ff5fd0e3040 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:20.626871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d83187-480a-4214-8bd5-06213bcf8e89 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:20.669442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e50d2-42fd-44f2-abf7-4ff5fd0e3040 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:20.705144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabc176-fa20-4e19-958b-98a11e7f0608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:20.706415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabc176-fa20-4e19-958b-98a11e7f0608 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:20.706757 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabc176-fa20-4e19-958b-98a11e7f0608 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:20.707108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabc176-fa20-4e19-958b-98a11e7f0608 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:20.707813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabc176-fa20-4e19-958b-98a11e7f0608 None admin] RBAC: Adding query filter params (type=network) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:20.708224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabc176-fa20-4e19-958b-98a11e7f0608 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:20.709585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabc176-fa20-4e19-958b-98a11e7f0608 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:20.714868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 399/780] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:20.715149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:20.720740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabc176-fa20-4e19-958b-98a11e7f0608 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:20.735537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb20af-dd06-4349-b296-6c965fa39308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:20.736344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb20af-dd06-4349-b296-6c965fa39308 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:20.736629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb20af-dd06-4349-b296-6c965fa39308 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:20.736936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb20af-dd06-4349-b296-6c965fa39308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:20.759494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb20af-dd06-4349-b296-6c965fa39308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-09cb20af-dd06-4349-b296-6c965fa39308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:20.774241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:20.775227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:20.776228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 382/781] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:20.783733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb20af-dd06-4349-b296-6c965fa39308 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:20.871239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabc176-fa20-4e19-958b-98a11e7f0608 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:20.911076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca221b-e9c8-4db9-a3e8-b38db2aa65b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:20.912142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca221b-e9c8-4db9-a3e8-b38db2aa65b2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:20.912641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca221b-e9c8-4db9-a3e8-b38db2aa65b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:20.913138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca221b-e9c8-4db9-a3e8-b38db2aa65b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:20.914142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca221b-e9c8-4db9-a3e8-b38db2aa65b2 None admin] RBAC: Adding query filter params (interface=public, service_id=39621ac70c6c4e1fbb41b4273f759569, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:20.914666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca221b-e9c8-4db9-a3e8-b38db2aa65b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:20.916262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca221b-e9c8-4db9-a3e8-b38db2aa65b2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:20.924560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 400/782] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 09:28:20 2022] GET /identity/v3/endpoints?service_id=39621ac70c6c4e1fbb41b4273f759569&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:20.929375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca221b-e9c8-4db9-a3e8-b38db2aa65b2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:21.007218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:21.008713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb20af-dd06-4349-b296-6c965fa39308 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:21.062186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:21.084135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa34d2-a9fa-431e-955b-c1c434e99162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:21.084818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa34d2-a9fa-431e-955b-c1c434e99162 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:21.085106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa34d2-a9fa-431e-955b-c1c434e99162 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:21.085236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca221b-e9c8-4db9-a3e8-b38db2aa65b2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:21.085395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa34d2-a9fa-431e-955b-c1c434e99162 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:21.086169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa34d2-a9fa-431e-955b-c1c434e99162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:21.086481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa34d2-a9fa-431e-955b-c1c434e99162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:21.087900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa34d2-a9fa-431e-955b-c1c434e99162 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:21.105892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 383/783] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:21.123883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa34d2-a9fa-431e-955b-c1c434e99162 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:21.125750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193c558-d7f7-4905-8212-5b582f627457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:21.126489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193c558-d7f7-4905-8212-5b582f627457 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:21.126780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193c558-d7f7-4905-8212-5b582f627457 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:21.127091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193c558-d7f7-4905-8212-5b582f627457 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:21.128788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193c558-d7f7-4905-8212-5b582f627457 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:21.130043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193c558-d7f7-4905-8212-5b582f627457 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:21.135837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 401/784] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 09:28:20 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:21.284365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa34d2-a9fa-431e-955b-c1c434e99162 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:21.338192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f90d-53cc-47e0-aa9a-36d0e76cc99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:21.339028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f90d-53cc-47e0-aa9a-36d0e76cc99f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:21.339311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f90d-53cc-47e0-aa9a-36d0e76cc99f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:21.339587 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f90d-53cc-47e0-aa9a-36d0e76cc99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:21.356907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835f90d-53cc-47e0-aa9a-36d0e76cc99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:21.358387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835f90d-53cc-47e0-aa9a-36d0e76cc99f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-9835f90d-53cc-47e0-aa9a-36d0e76cc99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:21.381009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:21.382277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:21.383208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:21.383208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:21.383208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:21.383208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:21.383208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 384/785] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:21.388206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193c558-d7f7-4905-8212-5b582f627457 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:21.500369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193c558-d7f7-4905-8212-5b582f627457 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:21.501966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:21.537395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1d70c-bf06-49f1-a2a2-1f77779709a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:21.538229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1d70c-bf06-49f1-a2a2-1f77779709a3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:21.539204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1d70c-bf06-49f1-a2a2-1f77779709a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:21.539870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1d70c-bf06-49f1-a2a2-1f77779709a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:21.540630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1d70c-bf06-49f1-a2a2-1f77779709a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:21.541189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1d70c-bf06-49f1-a2a2-1f77779709a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:21.543144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1d70c-bf06-49f1-a2a2-1f77779709a3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:21.679274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 402/786] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:21.684966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f90d-53cc-47e0-aa9a-36d0e76cc99f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:21.756973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:21.835659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f90d-53cc-47e0-aa9a-36d0e76cc99f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:21.881915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f806c-f719-43a0-b4dd-cafe0249f010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:21.882719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f806c-f719-43a0-b4dd-cafe0249f010 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:21.883028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f806c-f719-43a0-b4dd-cafe0249f010 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:21.883302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f806c-f719-43a0-b4dd-cafe0249f010 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:21.896968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f806c-f719-43a0-b4dd-cafe0249f010 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:21.898450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f806c-f719-43a0-b4dd-cafe0249f010 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d43f806c-f719-43a0-b4dd-cafe0249f010 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:21.916281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:21.917248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:21.918639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 385/787] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:21.925767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1d70c-bf06-49f1-a2a2-1f77779709a3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:22.077030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1d70c-bf06-49f1-a2a2-1f77779709a3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:22.120579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5839e-3c24-49ce-bbfe-f3c4538080ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:22.121247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5839e-3c24-49ce-bbfe-f3c4538080ff None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.121529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5839e-3c24-49ce-bbfe-f3c4538080ff None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.121855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5839e-3c24-49ce-bbfe-f3c4538080ff None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.122691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5839e-3c24-49ce-bbfe-f3c4538080ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:22.123022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5839e-3c24-49ce-bbfe-f3c4538080ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:22.124451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5839e-3c24-49ce-bbfe-f3c4538080ff None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:22.150410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 403/788] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 09:28:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:22.155605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f806c-f719-43a0-b4dd-cafe0249f010 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:22.260514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:22.271551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f806c-f719-43a0-b4dd-cafe0249f010 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:22.313967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663c001-cebc-471f-a0cf-3e44f8afc5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:22.314811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663c001-cebc-471f-a0cf-3e44f8afc5ac None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.315985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663c001-cebc-471f-a0cf-3e44f8afc5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.316338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663c001-cebc-471f-a0cf-3e44f8afc5ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.329370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663c001-cebc-471f-a0cf-3e44f8afc5ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:22.330083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb07868-360d-4b31-8f5e-d5012b6c901f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.330375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb07868-360d-4b31-8f5e-d5012b6c901f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.330729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb07868-360d-4b31-8f5e-d5012b6c901f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.331374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663c001-cebc-471f-a0cf-3e44f8afc5ac None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:22.333532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 404/789] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:22.340171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390d9d-c6d0-441f-b72c-471b4bf001c8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.340464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390d9d-c6d0-441f-b72c-471b4bf001c8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.340801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390d9d-c6d0-441f-b72c-471b4bf001c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c663c001-cebc-471f-a0cf-3e44f8afc5ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:22.353072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:22.354046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:22.355402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:22.355402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:22.355402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:22.355402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:22.355402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 386/790] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:22.360793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663c001-cebc-471f-a0cf-3e44f8afc5ac None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:22.382893 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-08390d9d-c6d0-441f-b72c-471b4bf001c8 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:22.384215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-08390d9d-c6d0-441f-b72c-471b4bf001c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:22.412603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:22.488098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 405/791] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:22.489555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecc771-36a5-41c8-86ab-8b96a2805cf5 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.489854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecc771-36a5-41c8-86ab-8b96a2805cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.490137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecc771-36a5-41c8-86ab-8b96a2805cf5 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.491654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 406/792] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:22.491771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663c001-cebc-471f-a0cf-3e44f8afc5ac None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:22.498104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09d3f4-fbd2-4f03-9042-040f1e00763b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.498392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09d3f4-fbd2-4f03-9042-040f1e00763b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.498674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09d3f4-fbd2-4f03-9042-040f1e00763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.523431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2c09d3f4-fbd2-4f03-9042-040f1e00763b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:22.524616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2c09d3f4-fbd2-4f03-9042-040f1e00763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:22.537824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e8948-a5de-469d-9c26-38a8e1244728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:22.539173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e8948-a5de-469d-9c26-38a8e1244728 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.540190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e8948-a5de-469d-9c26-38a8e1244728 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.540672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e8948-a5de-469d-9c26-38a8e1244728 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.541849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e8948-a5de-469d-9c26-38a8e1244728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:22.542600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e8948-a5de-469d-9c26-38a8e1244728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:22.544608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e8948-a5de-469d-9c26-38a8e1244728 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:22.560772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 387/793] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:22.562829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e8948-a5de-469d-9c26-38a8e1244728 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:22.581250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:22.604792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 407/794] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:22.605983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09d3f4-fbd2-4f03-9042-040f1e00763b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:22.697940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e8948-a5de-469d-9c26-38a8e1244728 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:22.714759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:22.736220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09d3f4-fbd2-4f03-9042-040f1e00763b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:22.742712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8415d-aa90-4cb8-88dd-c4f66fc0eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:22.743894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8415d-aa90-4cb8-88dd-c4f66fc0eee8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.744477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8415d-aa90-4cb8-88dd-c4f66fc0eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.744949 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8415d-aa90-4cb8-88dd-c4f66fc0eee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.757929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8415d-aa90-4cb8-88dd-c4f66fc0eee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3cb8415d-aa90-4cb8-88dd-c4f66fc0eee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:22.766690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:22.767634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:22.768523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:22.771303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 388/795] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:22.771932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53634cd-8c1e-4771-afbb-db879e19b138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:22.772550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8415d-aa90-4cb8-88dd-c4f66fc0eee8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:22.772807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53634cd-8c1e-4771-afbb-db879e19b138 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.773132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53634cd-8c1e-4771-afbb-db879e19b138 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.773411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53634cd-8c1e-4771-afbb-db879e19b138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.784573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53634cd-8c1e-4771-afbb-db879e19b138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:22.785992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53634cd-8c1e-4771-afbb-db879e19b138 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a53634cd-8c1e-4771-afbb-db879e19b138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:22.801118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:22.802119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:22.803013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:22.803013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:22.803013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:22.803013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:22.803013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:22.803013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:22.803013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:22.803013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:22.803013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 408/796] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:22.807724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265211-5435-4989-9eab-6bea410febc9 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.808022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265211-5435-4989-9eab-6bea410febc9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.808307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc265211-5435-4989-9eab-6bea410febc9 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.809842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 409/797] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:22.810564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc265211-5435-4989-9eab-6bea410febc9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:22.860401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:22.891165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8415d-aa90-4cb8-88dd-c4f66fc0eee8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:22.919882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc265211-5435-4989-9eab-6bea410febc9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:22.928473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99784038-8124-4010-b301-9d61f6fa00ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:22.929428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99784038-8124-4010-b301-9d61f6fa00ca None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.929812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99784038-8124-4010-b301-9d61f6fa00ca None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.930185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99784038-8124-4010-b301-9d61f6fa00ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.930962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99784038-8124-4010-b301-9d61f6fa00ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:22.932426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99784038-8124-4010-b301-9d61f6fa00ca None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-99784038-8124-4010-b301-9d61f6fa00ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:22.945466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:22.946608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 09:28:22.947664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:22.949240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 389/798] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Jun 24 09:28:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:22.950140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99784038-8124-4010-b301-9d61f6fa00ca None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:22.958484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67058c-9466-4fee-b9c8-1e8ef9be857c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:22.959283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67058c-9466-4fee-b9c8-1e8ef9be857c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.959640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67058c-9466-4fee-b9c8-1e8ef9be857c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.960417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67058c-9466-4fee-b9c8-1e8ef9be857c None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.961254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67058c-9466-4fee-b9c8-1e8ef9be857c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:22.961641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67058c-9466-4fee-b9c8-1e8ef9be857c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:22.963793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67058c-9466-4fee-b9c8-1e8ef9be857c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:22.977767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 410/799] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:22.977767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d07e63-34f3-45b5-9b61-fcfc5d46c506 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:22.977767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d07e63-34f3-45b5-9b61-fcfc5d46c506 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:22.977767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d07e63-34f3-45b5-9b61-fcfc5d46c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:22.979600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:22.991781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-50d07e63-34f3-45b5-9b61-fcfc5d46c506 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:22.992967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-50d07e63-34f3-45b5-9b61-fcfc5d46c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:23.060476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99784038-8124-4010-b301-9d61f6fa00ca None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.060977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 411/800] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:23.062132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d07e63-34f3-45b5-9b61-fcfc5d46c506 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.107491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f72a6-f275-4d51-aaeb-b0b8a493117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.108329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f72a6-f275-4d51-aaeb-b0b8a493117a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.109394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f72a6-f275-4d51-aaeb-b0b8a493117a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.109930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f72a6-f275-4d51-aaeb-b0b8a493117a None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.110775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f72a6-f275-4d51-aaeb-b0b8a493117a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:23.111068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f72a6-f275-4d51-aaeb-b0b8a493117a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:23.112520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f72a6-f275-4d51-aaeb-b0b8a493117a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:23.115948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:23.134522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 390/801] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:23.134522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f72a6-f275-4d51-aaeb-b0b8a493117a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.177000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d07e63-34f3-45b5-9b61-fcfc5d46c506 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.208554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:23.214191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41250f-2047-43c4-b220-4bb0103c7c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.214898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41250f-2047-43c4-b220-4bb0103c7c1d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.215196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41250f-2047-43c4-b220-4bb0103c7c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.216164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41250f-2047-43c4-b220-4bb0103c7c1d None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.216164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41250f-2047-43c4-b220-4bb0103c7c1d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:23.216567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41250f-2047-43c4-b220-4bb0103c7c1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:23.217925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41250f-2047-43c4-b220-4bb0103c7c1d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:23.223309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 412/802] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 09:28:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:23.224013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41250f-2047-43c4-b220-4bb0103c7c1d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.254025 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f72a6-f275-4d51-aaeb-b0b8a493117a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.291953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f68c-0e82-4292-a044-a70fa64fafd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.292846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f68c-0e82-4292-a044-a70fa64fafd5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.293136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f68c-0e82-4292-a044-a70fa64fafd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.293415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f68c-0e82-4292-a044-a70fa64fafd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.304800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2f68c-0e82-4292-a044-a70fa64fafd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:23.306267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2f68c-0e82-4292-a044-a70fa64fafd5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-2df2f68c-0e82-4292-a044-a70fa64fafd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:23.324728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:23.325626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:23.326528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:23.326528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:23.326528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:23.326528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:23.326528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 391/803] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:23.326805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f68c-0e82-4292-a044-a70fa64fafd5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.339425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41250f-2047-43c4-b220-4bb0103c7c1d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.377084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2900e9a-3e12-42a3-8874-17a19d848fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.378382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2900e9a-3e12-42a3-8874-17a19d848fae None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.378668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2900e9a-3e12-42a3-8874-17a19d848fae None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.378980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2900e9a-3e12-42a3-8874-17a19d848fae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.380586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:23.391285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2900e9a-3e12-42a3-8874-17a19d848fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c2900e9a-3e12-42a3-8874-17a19d848fae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:23.399866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:23.400965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:23.401978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:23.406090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 413/804] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:23.407086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2900e9a-3e12-42a3-8874-17a19d848fae None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.439714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f68c-0e82-4292-a044-a70fa64fafd5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.466610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:23.476219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af33c39-5958-4377-8938-92a46f43ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.481435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af33c39-5958-4377-8938-92a46f43ddca None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.481435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af33c39-5958-4377-8938-92a46f43ddca None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.481435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af33c39-5958-4377-8938-92a46f43ddca None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/25606976e6fe4daf9a552368088cdef1/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.481435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af33c39-5958-4377-8938-92a46f43ddca None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=25606976e6fe4daf9a552368088cdef1, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:23.481435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af33c39-5958-4377-8938-92a46f43ddca None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:23.513183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2900e9a-3e12-42a3-8874-17a19d848fae None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.548111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf020c6f-a9d7-49c3-aadc-54e772374695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.548776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf020c6f-a9d7-49c3-aadc-54e772374695 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.549057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf020c6f-a9d7-49c3-aadc-54e772374695 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.549405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf020c6f-a9d7-49c3-aadc-54e772374695 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.550679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf020c6f-a9d7-49c3-aadc-54e772374695 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:23.550998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf020c6f-a9d7-49c3-aadc-54e772374695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:23.563343 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 392/805] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:23 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/25606976e6fe4daf9a552368088cdef1/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:23.563343 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af33c39-5958-4377-8938-92a46f43ddca None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.563643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf020c6f-a9d7-49c3-aadc-54e772374695 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:23.573441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 414/806] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 09:28:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:23.574429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf020c6f-a9d7-49c3-aadc-54e772374695 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.704984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf020c6f-a9d7-49c3-aadc-54e772374695 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.705179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af33c39-5958-4377-8938-92a46f43ddca None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.716410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:23.735700 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:23.748194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470443e-c2c3-4bfc-92ef-a0cb598fcbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.748869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470443e-c2c3-4bfc-92ef-a0cb598fcbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.748988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47bfa61-0915-499b-acb0-f0563c3a60ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.749159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470443e-c2c3-4bfc-92ef-a0cb598fcbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.749438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470443e-c2c3-4bfc-92ef-a0cb598fcbc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.749693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bfa61-0915-499b-acb0-f0563c3a60ca None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.749983 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bfa61-0915-499b-acb0-f0563c3a60ca None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.750188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470443e-c2c3-4bfc-92ef-a0cb598fcbc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:23.750291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47bfa61-0915-499b-acb0-f0563c3a60ca None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.750498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470443e-c2c3-4bfc-92ef-a0cb598fcbc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:23.751007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bfa61-0915-499b-acb0-f0563c3a60ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:23.751312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bfa61-0915-499b-acb0-f0563c3a60ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:23.751968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470443e-c2c3-4bfc-92ef-a0cb598fcbc7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:23.753283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47bfa61-0915-499b-acb0-f0563c3a60ca None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:23.761617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 415/807] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:23.768959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470443e-c2c3-4bfc-92ef-a0cb598fcbc7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.769183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 393/808] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:23.770658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4c0d-7da3-4e6c-9f55-57be08320615 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.771138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4c0d-7da3-4e6c-9f55-57be08320615 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.771422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4c0d-7da3-4e6c-9f55-57be08320615 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.772956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 394/809] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:23.773893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4c0d-7da3-4e6c-9f55-57be08320615 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.868022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470443e-c2c3-4bfc-92ef-a0cb598fcbc7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.886621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4c0d-7da3-4e6c-9f55-57be08320615 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:23.902351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a25f21-7439-46ed-abca-f3fbcb0d7d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.903039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25f21-7439-46ed-abca-f3fbcb0d7d34 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.903329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25f21-7439-46ed-abca-f3fbcb0d7d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.903605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a25f21-7439-46ed-abca-f3fbcb0d7d34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.904349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a25f21-7439-46ed-abca-f3fbcb0d7d34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:23.905750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a25f21-7439-46ed-abca-f3fbcb0d7d34 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:23.925190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503cbbb-4ee6-4544-a9ff-e3040440df93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:23.925979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503cbbb-4ee6-4544-a9ff-e3040440df93 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.926261 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503cbbb-4ee6-4544-a9ff-e3040440df93 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.926628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503cbbb-4ee6-4544-a9ff-e3040440df93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:23.937533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503cbbb-4ee6-4544-a9ff-e3040440df93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:23.939066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503cbbb-4ee6-4544-a9ff-e3040440df93 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c503cbbb-4ee6-4544-a9ff-e3040440df93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:23.957336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:23.958378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:23.959464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:23.959464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:23.959464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:23.959464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:23.959464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 395/810] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:23.959464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503cbbb-4ee6-4544-a9ff-e3040440df93 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:23.983477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:23.992710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 416/811] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 09:28:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:23.994160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a8406-c2f9-4051-b1a4-11d4fea93eb6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:23.994465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a8406-c2f9-4051-b1a4-11d4fea93eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:23.994748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a8406-c2f9-4051-b1a4-11d4fea93eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.014000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a16a8406-c2f9-4051-b1a4-11d4fea93eb6 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:24.015521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a16a8406-c2f9-4051-b1a4-11d4fea93eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:24.054009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:24.101893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503cbbb-4ee6-4544-a9ff-e3040440df93 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:24.122997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 417/812] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:24.124050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a8406-c2f9-4051-b1a4-11d4fea93eb6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:24.159864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece3d7-ce8b-48e9-815a-d7871bc19b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:24.160676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece3d7-ce8b-48e9-815a-d7871bc19b3b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:24.160956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece3d7-ce8b-48e9-815a-d7871bc19b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:24.161231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdece3d7-ce8b-48e9-815a-d7871bc19b3b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.169088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdece3d7-ce8b-48e9-815a-d7871bc19b3b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:24.170560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdece3d7-ce8b-48e9-815a-d7871bc19b3b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-bdece3d7-ce8b-48e9-815a-d7871bc19b3b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:24.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:24.186733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:24.187716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 396/813] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 09:28:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:24.188291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece3d7-ce8b-48e9-815a-d7871bc19b3b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:24.241889 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a8406-c2f9-4051-b1a4-11d4fea93eb6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:24.285264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47843f2-41e9-461b-8cd5-ecca3369c43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:24.285936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47843f2-41e9-461b-8cd5-ecca3369c43f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:24.286340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47843f2-41e9-461b-8cd5-ecca3369c43f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:24.286628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47843f2-41e9-461b-8cd5-ecca3369c43f None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.287387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47843f2-41e9-461b-8cd5-ecca3369c43f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:24.287698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47843f2-41e9-461b-8cd5-ecca3369c43f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:24.289263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47843f2-41e9-461b-8cd5-ecca3369c43f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:24.293220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:24.302702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 418/814] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:24.303600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47843f2-41e9-461b-8cd5-ecca3369c43f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:24.330138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdece3d7-ce8b-48e9-815a-d7871bc19b3b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:24.336875 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:24.379775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789b31-12eb-4f76-b08a-b19ac3cbfa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:24.381254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789b31-12eb-4f76-b08a-b19ac3cbfa3b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:24.381544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789b31-12eb-4f76-b08a-b19ac3cbfa3b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:24.381969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789b31-12eb-4f76-b08a-b19ac3cbfa3b None admin] PATH_INFO: `/v3/services/network` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.382792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789b31-12eb-4f76-b08a-b19ac3cbfa3b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:24.385162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789b31-12eb-4f76-b08a-b19ac3cbfa3b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-70789b31-12eb-4f76-b08a-b19ac3cbfa3b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:24.400595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:24.401810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:24.402834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 397/815] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:24 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:24.403805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789b31-12eb-4f76-b08a-b19ac3cbfa3b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:24.431011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47843f2-41e9-461b-8cd5-ecca3369c43f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:24.473761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f3190-a16c-47a6-946b-5f4e35bd62e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:24.474443 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3190-a16c-47a6-946b-5f4e35bd62e1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:24.474731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3190-a16c-47a6-946b-5f4e35bd62e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:24.475041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f3190-a16c-47a6-946b-5f4e35bd62e1 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.475888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f3190-a16c-47a6-946b-5f4e35bd62e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:24.476203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f3190-a16c-47a6-946b-5f4e35bd62e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:24.477629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f3190-a16c-47a6-946b-5f4e35bd62e1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:24.495859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 419/816] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 09:28:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:24.496639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f3190-a16c-47a6-946b-5f4e35bd62e1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:24.528189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789b31-12eb-4f76-b08a-b19ac3cbfa3b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:24.565338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5ca66-7aae-4a80-8840-8b5e3d6afb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:24.566222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5ca66-7aae-4a80-8840-8b5e3d6afb84 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:24.566506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5ca66-7aae-4a80-8840-8b5e3d6afb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:24.566784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5ca66-7aae-4a80-8840-8b5e3d6afb84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.580514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5ca66-7aae-4a80-8840-8b5e3d6afb84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:24.582042 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5ca66-7aae-4a80-8840-8b5e3d6afb84 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:24.595249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e9d5ca66-7aae-4a80-8840-8b5e3d6afb84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:24.601387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:24.602530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:24.603594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:24.607308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 398/817] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:28:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:24.607835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f3190-a16c-47a6-946b-5f4e35bd62e1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:24.608161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5ca66-7aae-4a80-8840-8b5e3d6afb84 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:24.613265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:24.646118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c018945-ff29-4020-9484-5dcc2e4d4be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:24.647256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c018945-ff29-4020-9484-5dcc2e4d4be6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:24.647729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c018945-ff29-4020-9484-5dcc2e4d4be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:24.648191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c018945-ff29-4020-9484-5dcc2e4d4be6 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.649111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c018945-ff29-4020-9484-5dcc2e4d4be6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:24.649600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c018945-ff29-4020-9484-5dcc2e4d4be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:24.651316 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c018945-ff29-4020-9484-5dcc2e4d4be6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:24.656527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 420/818] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:24.657508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c018945-ff29-4020-9484-5dcc2e4d4be6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:24.720377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5ca66-7aae-4a80-8840-8b5e3d6afb84 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:24.760270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fdec9-51f1-4b5c-b77f-ec5676cf5113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:24.760270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fdec9-51f1-4b5c-b77f-ec5676cf5113 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:24.760270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fdec9-51f1-4b5c-b77f-ec5676cf5113 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:24.760587 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fdec9-51f1-4b5c-b77f-ec5676cf5113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.766976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c018945-ff29-4020-9484-5dcc2e4d4be6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:24.804517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329b5b-3a35-4088-95ac-239ee52952e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:24.805530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329b5b-3a35-4088-95ac-239ee52952e9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:24.805998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329b5b-3a35-4088-95ac-239ee52952e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:24.806484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59329b5b-3a35-4088-95ac-239ee52952e9 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.807551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329b5b-3a35-4088-95ac-239ee52952e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:24.808047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329b5b-3a35-4088-95ac-239ee52952e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:24.809673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59329b5b-3a35-4088-95ac-239ee52952e9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:24.829015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 421/819] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 09:28:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:24.830191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329b5b-3a35-4088-95ac-239ee52952e9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:24.839425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:24.842156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fdec9-51f1-4b5c-b77f-ec5676cf5113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:24.843697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fdec9-51f1-4b5c-b77f-ec5676cf5113 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:24.846534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:24.949119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59329b5b-3a35-4088-95ac-239ee52952e9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:24.961254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 399/820] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:28:24.962176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fdec9-51f1-4b5c-b77f-ec5676cf5113 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:24.994145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd90ce-d410-4267-b757-c7b61e22f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:24.995605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd90ce-d410-4267-b757-c7b61e22f205 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:24.996477 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd90ce-d410-4267-b757-c7b61e22f205 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:24.996786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd90ce-d410-4267-b757-c7b61e22f205 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:24.997496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd90ce-d410-4267-b757-c7b61e22f205 None admin] RBAC: Adding query filter params (type=network) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:24.997807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd90ce-d410-4267-b757-c7b61e22f205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:24.999200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd90ce-d410-4267-b757-c7b61e22f205 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:25.005099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 422/821] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:25.006065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd90ce-d410-4267-b757-c7b61e22f205 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:25.079392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:25.088073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fdec9-51f1-4b5c-b77f-ec5676cf5113 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:25.091079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:25.116006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd90ce-d410-4267-b757-c7b61e22f205 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:25.136762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a00c9-acfc-4a01-8ca0-a539c339d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:25.137389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a00c9-acfc-4a01-8ca0-a539c339d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.137676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a00c9-acfc-4a01-8ca0-a539c339d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.137959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a00c9-acfc-4a01-8ca0-a539c339d9a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.148793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a00c9-acfc-4a01-8ca0-a539c339d9a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:25.151302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a00c9-acfc-4a01-8ca0-a539c339d9a9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:25.156139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7bbb4-da5d-4de8-9fe0-ccbe809de7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:25.157226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7bbb4-da5d-4de8-9fe0-ccbe809de7af None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.157719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7bbb4-da5d-4de8-9fe0-ccbe809de7af None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.158195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7bbb4-da5d-4de8-9fe0-ccbe809de7af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.168925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7bbb4-da5d-4de8-9fe0-ccbe809de7af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:25.170633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7bbb4-da5d-4de8-9fe0-ccbe809de7af None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-eb5a00c9-acfc-4a01-8ca0-a539c339d9a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:25.170834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:25.171701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:25.172595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:25.172595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:25.172595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:25.172595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:25.176960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 400/822] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:25.177790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a00c9-acfc-4a01-8ca0-a539c339d9a9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-22a7bbb4-da5d-4de8-9fe0-ccbe809de7af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:25.197058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:25.198361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:25.199297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:25.199297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:25.199297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:25.199297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:25.199297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 423/823] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:25.199297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7bbb4-da5d-4de8-9fe0-ccbe809de7af None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:25.307217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a00c9-acfc-4a01-8ca0-a539c339d9a9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:25.315911 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7bbb4-da5d-4de8-9fe0-ccbe809de7af None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:25.337304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:25.348478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403e1d3-731d-4963-bad5-312ebf8f27f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:25.349939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403e1d3-731d-4963-bad5-312ebf8f27f3 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.350209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403e1d3-731d-4963-bad5-312ebf8f27f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.350784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403e1d3-731d-4963-bad5-312ebf8f27f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.351818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403e1d3-731d-4963-bad5-312ebf8f27f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:25.352167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb724c19-ad5e-4dc2-96fd-2630f8ffeacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:25.352991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724c19-ad5e-4dc2-96fd-2630f8ffeacf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.353379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724c19-ad5e-4dc2-96fd-2630f8ffeacf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.353765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb724c19-ad5e-4dc2-96fd-2630f8ffeacf None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.354055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403e1d3-731d-4963-bad5-312ebf8f27f3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:25.354689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb724c19-ad5e-4dc2-96fd-2630f8ffeacf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:25.355130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb724c19-ad5e-4dc2-96fd-2630f8ffeacf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:25.356599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb724c19-ad5e-4dc2-96fd-2630f8ffeacf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:25.373649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 424/824] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:25.373649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb724c19-ad5e-4dc2-96fd-2630f8ffeacf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:25.417359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 401/825] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 09:28:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:25.418433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403e1d3-731d-4963-bad5-312ebf8f27f3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:25.438521 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:25.557196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb724c19-ad5e-4dc2-96fd-2630f8ffeacf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:25.573479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403e1d3-731d-4963-bad5-312ebf8f27f3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:25.622740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a30b0-ed18-4beb-8041-3a1d83ad44fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:25.624058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a30b0-ed18-4beb-8041-3a1d83ad44fa None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.624826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a30b0-ed18-4beb-8041-3a1d83ad44fa None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.625270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a30b0-ed18-4beb-8041-3a1d83ad44fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.635559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a30b0-ed18-4beb-8041-3a1d83ad44fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:25.638142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a30b0-ed18-4beb-8041-3a1d83ad44fa None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a07a30b0-ed18-4beb-8041-3a1d83ad44fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:25.655967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:25.657135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:25.658262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:25.658262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:25.658262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:25.658262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:25.658262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:25.658262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:25.658262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:25.658262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:25.660293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 402/826] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:25.662199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309df33-9557-4a0f-bfb7-bc0edf0b1baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:25.663234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309df33-9557-4a0f-bfb7-bc0edf0b1baf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.663676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309df33-9557-4a0f-bfb7-bc0edf0b1baf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.664103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309df33-9557-4a0f-bfb7-bc0edf0b1baf None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.665000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309df33-9557-4a0f-bfb7-bc0edf0b1baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:25.666016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a30b0-ed18-4beb-8041-3a1d83ad44fa None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:25.666885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309df33-9557-4a0f-bfb7-bc0edf0b1baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:25.671873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2309df33-9557-4a0f-bfb7-bc0edf0b1baf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:25.692625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 425/827] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:25.697704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309df33-9557-4a0f-bfb7-bc0edf0b1baf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:25.752493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:25.769787 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:25.809968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a30b0-ed18-4beb-8041-3a1d83ad44fa None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:25.820661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309df33-9557-4a0f-bfb7-bc0edf0b1baf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:25.846944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376100a-54ad-4e78-94a1-4cd77b00690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:25.847548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376100a-54ad-4e78-94a1-4cd77b00690b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.847860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376100a-54ad-4e78-94a1-4cd77b00690b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.848102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376100a-54ad-4e78-94a1-4cd77b00690b None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.848888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376100a-54ad-4e78-94a1-4cd77b00690b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:25.849199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376100a-54ad-4e78-94a1-4cd77b00690b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:25.850704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376100a-54ad-4e78-94a1-4cd77b00690b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:25.856344 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831ed51-590e-4653-8970-3530b2f6d561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:25.857144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ed51-590e-4653-8970-3530b2f6d561 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.857436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ed51-590e-4653-8970-3530b2f6d561 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.857697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ed51-590e-4653-8970-3530b2f6d561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.863967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 403/828] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:25.865531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b7ea7-466b-4f2f-bff0-570660340f41 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.865821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b7ea7-466b-4f2f-bff0-570660340f41 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.866098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b7ea7-466b-4f2f-bff0-570660340f41 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.867547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 404/829] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:25.870014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831ed51-590e-4653-8970-3530b2f6d561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:25.871509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831ed51-590e-4653-8970-3530b2f6d561 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:25.872033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b7ea7-466b-4f2f-bff0-570660340f41 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2831ed51-590e-4653-8970-3530b2f6d561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:25.886485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:25.887645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:25.888766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:25.888766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:25.888766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:25.888766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:25.888766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:25.888766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:25.888766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:25.888766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:25.890170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 426/830] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:25.892295 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce2f34-4490-41fa-9f5b-6812bd9122fd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:25.892837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce2f34-4490-41fa-9f5b-6812bd9122fd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:25.893809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce2f34-4490-41fa-9f5b-6812bd9122fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:25.912106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2dce2f34-4490-41fa-9f5b-6812bd9122fd None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:25.913286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2dce2f34-4490-41fa-9f5b-6812bd9122fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:25.987740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 427/831] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:25.988831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce2f34-4490-41fa-9f5b-6812bd9122fd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:26.000757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b7ea7-466b-4f2f-bff0-570660340f41 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:26.029019 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:26.032372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:26.040783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0e7b1-b7be-4a47-9764-cbfc5fe723c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:26.041789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0e7b1-b7be-4a47-9764-cbfc5fe723c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.042184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0e7b1-b7be-4a47-9764-cbfc5fe723c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.042563 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0e7b1-b7be-4a47-9764-cbfc5fe723c8 None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/2a5fd14de7794b14bd0a2a2a62a70762/roles/ea353bbe72d949cb9417cea310e8d194` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.057709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0e7b1-b7be-4a47-9764-cbfc5fe723c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=2a5fd14de7794b14bd0a2a2a62a70762, role_id=ea353bbe72d949cb9417cea310e8d194)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:26.059398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0e7b1-b7be-4a47-9764-cbfc5fe723c8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:26.101393 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce2f34-4490-41fa-9f5b-6812bd9122fd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:26.135687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de5be7-8300-40d8-8be2-c444f83848e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:26.136355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de5be7-8300-40d8-8be2-c444f83848e7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.136645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de5be7-8300-40d8-8be2-c444f83848e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.136925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de5be7-8300-40d8-8be2-c444f83848e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.137710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de5be7-8300-40d8-8be2-c444f83848e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:26.138048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de5be7-8300-40d8-8be2-c444f83848e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:26.139531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de5be7-8300-40d8-8be2-c444f83848e7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:26.146537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 405/832] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:25 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/2a5fd14de7794b14bd0a2a2a62a70762/roles/ea353bbe72d949cb9417cea310e8d194 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:26.148124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0e7b1-b7be-4a47-9764-cbfc5fe723c8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:26.157462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 428/833] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:26.158333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de5be7-8300-40d8-8be2-c444f83848e7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:26.269802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:26.281388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de5be7-8300-40d8-8be2-c444f83848e7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:26.298423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0e7b1-b7be-4a47-9764-cbfc5fe723c8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:26.326677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457c0a4-ca03-4e02-851a-c71aa93e7a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:26.327384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457c0a4-ca03-4e02-851a-c71aa93e7a85 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.327674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457c0a4-ca03-4e02-851a-c71aa93e7a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.327959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457c0a4-ca03-4e02-851a-c71aa93e7a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.328803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457c0a4-ca03-4e02-851a-c71aa93e7a85 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=0ec77816151b45228e087023588839da, user.id=0422e6863c7147b79ea4d194e6e07154) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:26.329121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457c0a4-ca03-4e02-851a-c71aa93e7a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:26.330638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457c0a4-ca03-4e02-851a-c71aa93e7a85 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:26.337068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 429/834] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:26 2022] GET /identity/v3/role_assignments?user.id=0422e6863c7147b79ea4d194e6e07154&scope.project.id=0ec77816151b45228e087023588839da&role.id=9312183c32b04118985c8316f33f3830 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:26.338396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6837854-2221-48c8-ae8d-c7ca0c5f725d None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.338658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6837854-2221-48c8-ae8d-c7ca0c5f725d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.339004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6837854-2221-48c8-ae8d-c7ca0c5f725d None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.340513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 430/835] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:26.342269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfa30b-d7e3-46cd-9a5c-7e7cb7e59c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:26.346889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfa30b-d7e3-46cd-9a5c-7e7cb7e59c28 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.346889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfa30b-d7e3-46cd-9a5c-7e7cb7e59c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.346889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfa30b-d7e3-46cd-9a5c-7e7cb7e59c28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.347199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba963b-324f-4c48-8b59-208aeb1324ed None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.347199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba963b-324f-4c48-8b59-208aeb1324ed None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.347586 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba963b-324f-4c48-8b59-208aeb1324ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.357449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfa30b-d7e3-46cd-9a5c-7e7cb7e59c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3dbfa30b-d7e3-46cd-9a5c-7e7cb7e59c28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:26.366414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:26.367458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:26.368286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:26.370271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8eba963b-324f-4c48-8b59-208aeb1324ed None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:26.371978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8eba963b-324f-4c48-8b59-208aeb1324ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:26.372646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 406/836] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:26.374008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfa30b-d7e3-46cd-9a5c-7e7cb7e59c28 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:26.421161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:26.468015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 431/837] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:26.491750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba963b-324f-4c48-8b59-208aeb1324ed None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:26.512415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfa30b-d7e3-46cd-9a5c-7e7cb7e59c28 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:26.554553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110f332-8d16-42d3-bf13-ae880f64156d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:26.555260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110f332-8d16-42d3-bf13-ae880f64156d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.555545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110f332-8d16-42d3-bf13-ae880f64156d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.555872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110f332-8d16-42d3-bf13-ae880f64156d None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.556626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110f332-8d16-42d3-bf13-ae880f64156d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:26.556933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110f332-8d16-42d3-bf13-ae880f64156d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:26.558312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110f332-8d16-42d3-bf13-ae880f64156d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:26.570975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 407/838] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:26.574059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110f332-8d16-42d3-bf13-ae880f64156d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:26.609695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:26.628638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba963b-324f-4c48-8b59-208aeb1324ed None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:26.677743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580767-030e-4751-8ead-8136c126a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:26.678713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580767-030e-4751-8ead-8136c126a311 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.679417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580767-030e-4751-8ead-8136c126a311 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.679702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580767-030e-4751-8ead-8136c126a311 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.680657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580767-030e-4751-8ead-8136c126a311 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:26.682202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580767-030e-4751-8ead-8136c126a311 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-b3580767-030e-4751-8ead-8136c126a311 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:26.698247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:26.699287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 09:28:26.700129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:26.700859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 432/839] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:28:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:26.700940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:26.706937 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580767-030e-4751-8ead-8136c126a311 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:26.708308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110f332-8d16-42d3-bf13-ae880f64156d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:26.756288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc723605-c696-4bbb-9c9a-8c5a57356ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:26.757108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc723605-c696-4bbb-9c9a-8c5a57356ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.757397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc723605-c696-4bbb-9c9a-8c5a57356ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.757743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc723605-c696-4bbb-9c9a-8c5a57356ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.772799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc723605-c696-4bbb-9c9a-8c5a57356ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:26.774550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc723605-c696-4bbb-9c9a-8c5a57356ee6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-bc723605-c696-4bbb-9c9a-8c5a57356ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:26.797538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:26.799320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:26.801436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:26.801436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:26.801436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:26.801436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:26.801436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 408/840] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:26.807520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc723605-c696-4bbb-9c9a-8c5a57356ee6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:26.826452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580767-030e-4751-8ead-8136c126a311 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:26.871914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b1ecd-7709-49a3-b725-d0270eb66ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:26.873390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b1ecd-7709-49a3-b725-d0270eb66ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.873891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b1ecd-7709-49a3-b725-d0270eb66ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.874605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b1ecd-7709-49a3-b725-d0270eb66ce1 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.875714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b1ecd-7709-49a3-b725-d0270eb66ce1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:26.876634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b1ecd-7709-49a3-b725-d0270eb66ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:26.878744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b1ecd-7709-49a3-b725-d0270eb66ce1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:26.885577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 433/841] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:28:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:26.893786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b1ecd-7709-49a3-b725-d0270eb66ce1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:26.910321 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:26.936189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc723605-c696-4bbb-9c9a-8c5a57356ee6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:26.983240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93c2ca-cde0-449f-9af6-3fd527fd5e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:26.984160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93c2ca-cde0-449f-9af6-3fd527fd5e0c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:26.984598 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93c2ca-cde0-449f-9af6-3fd527fd5e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:26.985724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93c2ca-cde0-449f-9af6-3fd527fd5e0c None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:26.986605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93c2ca-cde0-449f-9af6-3fd527fd5e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:26.987770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93c2ca-cde0-449f-9af6-3fd527fd5e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:26.989172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93c2ca-cde0-449f-9af6-3fd527fd5e0c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:27.003645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 409/842] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:27.008649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93c2ca-cde0-449f-9af6-3fd527fd5e0c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:27.019995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b1ecd-7709-49a3-b725-d0270eb66ce1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:27.029904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:27.059061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f3a32-1ecb-419b-9708-241a54f23c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:27.060361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f3a32-1ecb-419b-9708-241a54f23c36 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:27.060855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f3a32-1ecb-419b-9708-241a54f23c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:27.061635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f3a32-1ecb-419b-9708-241a54f23c36 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:27.062560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f3a32-1ecb-419b-9708-241a54f23c36 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:27.063149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f3a32-1ecb-419b-9708-241a54f23c36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:27.064887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f3a32-1ecb-419b-9708-241a54f23c36 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:27.070651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 434/843] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:28:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:27.130366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93c2ca-cde0-449f-9af6-3fd527fd5e0c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:27.169560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134417-cc3c-4bbf-a6cb-3f683329c2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:27.170380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134417-cc3c-4bbf-a6cb-3f683329c2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:27.170666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134417-cc3c-4bbf-a6cb-3f683329c2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:27.170972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134417-cc3c-4bbf-a6cb-3f683329c2f4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:27.180136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134417-cc3c-4bbf-a6cb-3f683329c2f4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:27.181629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134417-cc3c-4bbf-a6cb-3f683329c2f4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b2134417-cc3c-4bbf-a6cb-3f683329c2f4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:27.197196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:27.198196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:27.199634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 410/844] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:27.204581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f3a32-1ecb-419b-9708-241a54f23c36 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:27.287297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:27.310640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f3a32-1ecb-419b-9708-241a54f23c36 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:27.352552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7e360-add8-477b-8d89-fedc6e468db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:27.353291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7e360-add8-477b-8d89-fedc6e468db7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:27.353582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7e360-add8-477b-8d89-fedc6e468db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:27.353862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7e360-add8-477b-8d89-fedc6e468db7 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:27.354708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7e360-add8-477b-8d89-fedc6e468db7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:27.355047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7e360-add8-477b-8d89-fedc6e468db7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:27.356493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7e360-add8-477b-8d89-fedc6e468db7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:27.375942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 435/845] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 09:28:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:27.382645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134417-cc3c-4bbf-a6cb-3f683329c2f4 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:27.457562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:27.488763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134417-cc3c-4bbf-a6cb-3f683329c2f4 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:27.524141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176ac7b-a785-4423-b063-b3cf47db1f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:27.524795 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176ac7b-a785-4423-b063-b3cf47db1f5f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:27.525082 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176ac7b-a785-4423-b063-b3cf47db1f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:27.525361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176ac7b-a785-4423-b063-b3cf47db1f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:27.599909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176ac7b-a785-4423-b063-b3cf47db1f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:27.601635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176ac7b-a785-4423-b063-b3cf47db1f5f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:27.678038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:27.711478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 411/846] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:27 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:28:27.717342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7e360-add8-477b-8d89-fedc6e468db7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:27.822707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7e360-add8-477b-8d89-fedc6e468db7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:27.858655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9d83b-5fd5-4241-a47a-90193f4763ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:27.859491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9d83b-5fd5-4241-a47a-90193f4763ae None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:27.859785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9d83b-5fd5-4241-a47a-90193f4763ae None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:27.860320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9d83b-5fd5-4241-a47a-90193f4763ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:27.862793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:27.871528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9d83b-5fd5-4241-a47a-90193f4763ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:27.872992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9d83b-5fd5-4241-a47a-90193f4763ae None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e4a9d83b-5fd5-4241-a47a-90193f4763ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:27.891560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:27.892489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:27.894577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:27.894577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:27.894577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:27.894577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:27.894577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 436/847] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:27.899645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176ac7b-a785-4423-b063-b3cf47db1f5f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:28.004724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176ac7b-a785-4423-b063-b3cf47db1f5f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:28.040746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fba74d-3b0f-4f04-b524-b7c27acd17a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:28.041415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fba74d-3b0f-4f04-b524-b7c27acd17a0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.041703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fba74d-3b0f-4f04-b524-b7c27acd17a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.041977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fba74d-3b0f-4f04-b524-b7c27acd17a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.042706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fba74d-3b0f-4f04-b524-b7c27acd17a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:28.043046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fba74d-3b0f-4f04-b524-b7c27acd17a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:28.044428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fba74d-3b0f-4f04-b524-b7c27acd17a0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:28.060331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 412/848] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:28.066673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9d83b-5fd5-4241-a47a-90193f4763ae None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:28.184478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9d83b-5fd5-4241-a47a-90193f4763ae None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:28.222404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6cad1-e6d9-4175-8a1f-aa3aab31a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:28.223241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6cad1-e6d9-4175-8a1f-aa3aab31a01e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.223528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6cad1-e6d9-4175-8a1f-aa3aab31a01e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.223805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6cad1-e6d9-4175-8a1f-aa3aab31a01e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.230864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6cad1-e6d9-4175-8a1f-aa3aab31a01e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:28.232363 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6cad1-e6d9-4175-8a1f-aa3aab31a01e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d6f6cad1-e6d9-4175-8a1f-aa3aab31a01e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:28.247371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:28.248281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:28.249190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:28.249190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:28.249190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:28.249190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:28.249190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:28.249190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:28.249190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:28.249190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:28.249190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 437/849] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:28.256331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fba74d-3b0f-4f04-b524-b7c27acd17a0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:28.291445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:28.333547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6d92-48af-411f-8f8a-79aa0374087c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.334441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6d92-48af-411f-8f8a-79aa0374087c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.334981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd6d92-48af-411f-8f8a-79aa0374087c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.337808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 438/850] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:28:28.344384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7dc9f-faf4-4324-a070-45081fcd5e8a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.345322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7dc9f-faf4-4324-a070-45081fcd5e8a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.345846 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7dc9f-faf4-4324-a070-45081fcd5e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.370151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a8e7dc9f-faf4-4324-a070-45081fcd5e8a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:28.370339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fba74d-3b0f-4f04-b524-b7c27acd17a0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:28.372083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a8e7dc9f-faf4-4324-a070-45081fcd5e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:28.408357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58de4fd-0663-417d-87f8-795b21c912bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:28.409264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de4fd-0663-417d-87f8-795b21c912bf None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.409559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de4fd-0663-417d-87f8-795b21c912bf None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.409841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58de4fd-0663-417d-87f8-795b21c912bf None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.410629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58de4fd-0663-417d-87f8-795b21c912bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:28.410985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58de4fd-0663-417d-87f8-795b21c912bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:28.413095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58de4fd-0663-417d-87f8-795b21c912bf None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:28.432373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 413/851] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:28.432556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:28.434292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58de4fd-0663-417d-87f8-795b21c912bf None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:28.466663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 439/852] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:28.484478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7dc9f-faf4-4324-a070-45081fcd5e8a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:28.546513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:28.557136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58de4fd-0663-417d-87f8-795b21c912bf None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:28.590779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7dc9f-faf4-4324-a070-45081fcd5e8a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:28.601636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed9bc6e-69cf-4597-a440-f7bf9ccf9995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:28.602382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9bc6e-69cf-4597-a440-f7bf9ccf9995 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.602861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9bc6e-69cf-4597-a440-f7bf9ccf9995 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.603239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9bc6e-69cf-4597-a440-f7bf9ccf9995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.604088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9bc6e-69cf-4597-a440-f7bf9ccf9995 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=0ec77816151b45228e087023588839da, user.id=25606976e6fe4daf9a552368088cdef1) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:28.604406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9bc6e-69cf-4597-a440-f7bf9ccf9995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:28.605845 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed9bc6e-69cf-4597-a440-f7bf9ccf9995 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:28.623262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 414/853] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:28 2022] GET /identity/v3/role_assignments?user.id=25606976e6fe4daf9a552368088cdef1&scope.project.id=0ec77816151b45228e087023588839da&role.id=9312183c32b04118985c8316f33f3830 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:28.624943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22120df-5fb0-4661-aff4-3fbf7c6aa670 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.625240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22120df-5fb0-4661-aff4-3fbf7c6aa670 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.625533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22120df-5fb0-4661-aff4-3fbf7c6aa670 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.631255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 415/854] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:28.634303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88e283-af4c-47ee-ab3f-b82cc406fbf6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.634678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88e283-af4c-47ee-ab3f-b82cc406fbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.635037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88e283-af4c-47ee-ab3f-b82cc406fbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.636777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34478-8706-4a7c-a822-57d5df46464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:28.638064 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34478-8706-4a7c-a822-57d5df46464b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.638589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34478-8706-4a7c-a822-57d5df46464b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.639192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34478-8706-4a7c-a822-57d5df46464b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.652140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a34478-8706-4a7c-a822-57d5df46464b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:28.654249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bb88e283-af4c-47ee-ab3f-b82cc406fbf6 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:28.655610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bb88e283-af4c-47ee-ab3f-b82cc406fbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-13a34478-8706-4a7c-a822-57d5df46464b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:28.661576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:28.662613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:28:28.663504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:28.666227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 440/855] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:28.671932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34478-8706-4a7c-a822-57d5df46464b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:28.726232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:28.753401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 416/856] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:28.777430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88e283-af4c-47ee-ab3f-b82cc406fbf6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:28.806282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34478-8706-4a7c-a822-57d5df46464b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:28.845888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e0088-893b-4d2a-a7a6-67992f5426a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:28.846600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e0088-893b-4d2a-a7a6-67992f5426a5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.846913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e0088-893b-4d2a-a7a6-67992f5426a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.847220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e0088-893b-4d2a-a7a6-67992f5426a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.847980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e0088-893b-4d2a-a7a6-67992f5426a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:28.848289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e0088-893b-4d2a-a7a6-67992f5426a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:28.849705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e0088-893b-4d2a-a7a6-67992f5426a5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:28.860873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 441/857] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:28.867682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e0088-893b-4d2a-a7a6-67992f5426a5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:28.879266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:28.898576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88e283-af4c-47ee-ab3f-b82cc406fbf6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:28.947269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c1c1-b590-435e-977e-3dee98696de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:28.948415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c1c1-b590-435e-977e-3dee98696de9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:28.949813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c1c1-b590-435e-977e-3dee98696de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:28.950906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c1c1-b590-435e-977e-3dee98696de9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:28.951664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678c1c1-b590-435e-977e-3dee98696de9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:28.953750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678c1c1-b590-435e-977e-3dee98696de9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-5678c1c1-b590-435e-977e-3dee98696de9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:28.974542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:28.975789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 09:28:28.976816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:28.985218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 417/858] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Jun 24 09:28:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:28.986709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c1c1-b590-435e-977e-3dee98696de9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:29.002268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:29.007066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e0088-893b-4d2a-a7a6-67992f5426a5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:29.045925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637951-265a-4a60-8056-878cbdeac623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:29.046960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637951-265a-4a60-8056-878cbdeac623 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.047364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637951-265a-4a60-8056-878cbdeac623 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.047741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61637951-265a-4a60-8056-878cbdeac623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:29.060645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61637951-265a-4a60-8056-878cbdeac623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:29.062255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61637951-265a-4a60-8056-878cbdeac623 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-61637951-265a-4a60-8056-878cbdeac623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:29.087509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:29.089098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:29.090181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:29.090181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:29.090181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:29.090181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:29.092317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 442/859] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:29.100145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637951-265a-4a60-8056-878cbdeac623 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:29.217286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61637951-265a-4a60-8056-878cbdeac623 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:29.254190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c9af-1be1-4f8b-8d5f-ab834b05dae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:29.254921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c9af-1be1-4f8b-8d5f-ab834b05dae6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.255213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c9af-1be1-4f8b-8d5f-ab834b05dae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.255490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c9af-1be1-4f8b-8d5f-ab834b05dae6 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:29.256554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c9af-1be1-4f8b-8d5f-ab834b05dae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:29.256554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c9af-1be1-4f8b-8d5f-ab834b05dae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:29.257978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6c9af-1be1-4f8b-8d5f-ab834b05dae6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:29.271929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c1c1-b590-435e-977e-3dee98696de9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:29.275509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 443/860] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:29.275714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c9af-1be1-4f8b-8d5f-ab834b05dae6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:29.288908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:29.313114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e1122-e537-495f-a69d-2298c9661a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:29.313114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1122-e537-495f-a69d-2298c9661a7f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.313381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1122-e537-495f-a69d-2298c9661a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.313530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e1122-e537-495f-a69d-2298c9661a7f None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:29.314190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e1122-e537-495f-a69d-2298c9661a7f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:29.314501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e1122-e537-495f-a69d-2298c9661a7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:29.316031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e1122-e537-495f-a69d-2298c9661a7f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:29.325295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 418/861] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:29.326676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104c194-e949-4536-8977-94848ea84043 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.327003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104c194-e949-4536-8977-94848ea84043 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.327289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104c194-e949-4536-8977-94848ea84043 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:29.329016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 419/862] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:29.329800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104c194-e949-4536-8977-94848ea84043 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:29.346048 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:29.390492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c9af-1be1-4f8b-8d5f-ab834b05dae6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:29.426812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403613f-9460-4f06-a99e-9c85927cb312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:29.427654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403613f-9460-4f06-a99e-9c85927cb312 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.427950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403613f-9460-4f06-a99e-9c85927cb312 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.428218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403613f-9460-4f06-a99e-9c85927cb312 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:29.436521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403613f-9460-4f06-a99e-9c85927cb312 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:29.437932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403613f-9460-4f06-a99e-9c85927cb312 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:29.444019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104c194-e949-4536-8977-94848ea84043 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-4403613f-9460-4f06-a99e-9c85927cb312 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:29.453177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:29.454128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:29.455547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 444/863] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:28:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:29.457238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285fa95-41bb-4434-a03a-56d69335ed03 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.457238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285fa95-41bb-4434-a03a-56d69335ed03 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.457238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285fa95-41bb-4434-a03a-56d69335ed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:29.474955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1285fa95-41bb-4434-a03a-56d69335ed03 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:29.476122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1285fa95-41bb-4434-a03a-56d69335ed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:29.485414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30bb55-dce1-4cd1-bd40-8f4ffd646797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:29.486078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30bb55-dce1-4cd1-bd40-8f4ffd646797 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.486363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30bb55-dce1-4cd1-bd40-8f4ffd646797 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.486642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30bb55-dce1-4cd1-bd40-8f4ffd646797 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:29.487422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30bb55-dce1-4cd1-bd40-8f4ffd646797 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:29.487729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30bb55-dce1-4cd1-bd40-8f4ffd646797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:29.489109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b30bb55-dce1-4cd1-bd40-8f4ffd646797 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:29.494357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 420/864] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:29.495690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30bb55-dce1-4cd1-bd40-8f4ffd646797 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:29.548169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:29.561827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 445/865] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:29.581313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285fa95-41bb-4434-a03a-56d69335ed03 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:29.643758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:29.677559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30bb55-dce1-4cd1-bd40-8f4ffd646797 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:29.716329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285fa95-41bb-4434-a03a-56d69335ed03 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:29.722353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497abec-2831-4a28-919f-fcd2a616ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:29.723214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497abec-2831-4a28-919f-fcd2a616ab7a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.723601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497abec-2831-4a28-919f-fcd2a616ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.723983 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497abec-2831-4a28-919f-fcd2a616ab7a None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:29.724936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497abec-2831-4a28-919f-fcd2a616ab7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:29.725351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497abec-2831-4a28-919f-fcd2a616ab7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:29.727570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497abec-2831-4a28-919f-fcd2a616ab7a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:29.754943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 421/866] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 09:28:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:29.759377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497abec-2831-4a28-919f-fcd2a616ab7a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:29.765176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77089883-6e97-4d99-a022-d74371600a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:29.765984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77089883-6e97-4d99-a022-d74371600a85 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.766376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77089883-6e97-4d99-a022-d74371600a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.766754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77089883-6e97-4d99-a022-d74371600a85 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:29.767617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77089883-6e97-4d99-a022-d74371600a85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:29.769833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77089883-6e97-4d99-a022-d74371600a85 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:29.851400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 446/867] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:28:29 2022] POST /identity/v3/services => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:29.879697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497abec-2831-4a28-919f-fcd2a616ab7a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:29.921902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:29.927424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb1e04-caba-41f1-8c1e-8e9fe5053446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:29.928146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1e04-caba-41f1-8c1e-8e9fe5053446 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:29.928438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1e04-caba-41f1-8c1e-8e9fe5053446 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:29.928717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb1e04-caba-41f1-8c1e-8e9fe5053446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:30.014265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb1e04-caba-41f1-8c1e-8e9fe5053446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:30.016024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcb1e04-caba-41f1-8c1e-8e9fe5053446 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:30.128552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 422/868] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:29 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:28:30.133928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77089883-6e97-4d99-a022-d74371600a85 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:30.201446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:30.246283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77089883-6e97-4d99-a022-d74371600a85 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:30.281362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a359c-1ab4-4859-9c8b-ebf261bd1559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:30.282457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a359c-1ab4-4859-9c8b-ebf261bd1559 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:30.282919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a359c-1ab4-4859-9c8b-ebf261bd1559 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:30.283759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a359c-1ab4-4859-9c8b-ebf261bd1559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:30.296028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a359c-1ab4-4859-9c8b-ebf261bd1559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:30.297687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a359c-1ab4-4859-9c8b-ebf261bd1559 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-7a1a359c-1ab4-4859-9c8b-ebf261bd1559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:30.316239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:30.317312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:30.318401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:30.318401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:30.318401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:30.318401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:30.320254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 447/869] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:30.327971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb1e04-caba-41f1-8c1e-8e9fe5053446 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:30.362643 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:30.436544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb1e04-caba-41f1-8c1e-8e9fe5053446 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:30.473996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9110e8-ee99-4ca3-a634-3df6c3eac99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:30.474726 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9110e8-ee99-4ca3-a634-3df6c3eac99e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:30.474966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9110e8-ee99-4ca3-a634-3df6c3eac99e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:30.475251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9110e8-ee99-4ca3-a634-3df6c3eac99e None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:30.475974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9110e8-ee99-4ca3-a634-3df6c3eac99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:30.476283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9110e8-ee99-4ca3-a634-3df6c3eac99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:30.477654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9110e8-ee99-4ca3-a634-3df6c3eac99e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:30.490982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 423/870] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:30.496321 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a359c-1ab4-4859-9c8b-ebf261bd1559 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:30.603978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a359c-1ab4-4859-9c8b-ebf261bd1559 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:30.632171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:30.641354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991e20c-c562-4468-bad4-2f36cedc8752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:30.652339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e20c-c562-4468-bad4-2f36cedc8752 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:30.652339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e20c-c562-4468-bad4-2f36cedc8752 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:30.652339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991e20c-c562-4468-bad4-2f36cedc8752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:30.652339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991e20c-c562-4468-bad4-2f36cedc8752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:30.652978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991e20c-c562-4468-bad4-2f36cedc8752 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c991e20c-c562-4468-bad4-2f36cedc8752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:30.668731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:30.669876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:30.670762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:30.670762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:30.670762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:30.670762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:30.670762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:30.670762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:30.670762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:30.670762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:30.670762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 448/871] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:30.675906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9110e8-ee99-4ca3-a634-3df6c3eac99e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:30.776066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:30.786439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9110e8-ee99-4ca3-a634-3df6c3eac99e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:30.823280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18c1cf-6c26-4b96-914c-62257f2cdd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:30.824313 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c1cf-6c26-4b96-914c-62257f2cdd8c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:30.824803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c1cf-6c26-4b96-914c-62257f2cdd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:30.825284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c1cf-6c26-4b96-914c-62257f2cdd8c None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:30.826279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18c1cf-6c26-4b96-914c-62257f2cdd8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:30.826821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18c1cf-6c26-4b96-914c-62257f2cdd8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:30.828501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18c1cf-6c26-4b96-914c-62257f2cdd8c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:30.839976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b402a45-fb6b-4e66-ae15-5ee761a3c6ce None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:30.840268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b402a45-fb6b-4e66-ae15-5ee761a3c6ce None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:30.840595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b402a45-fb6b-4e66-ae15-5ee761a3c6ce None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:30.841908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 424/872] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:30.842173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 449/873] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:30.848624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158325a3-02bc-44c7-b156-c4cbe7970173 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:30.848912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158325a3-02bc-44c7-b156-c4cbe7970173 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:30.849192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158325a3-02bc-44c7-b156-c4cbe7970173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:30.851258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b402a45-fb6b-4e66-ae15-5ee761a3c6ce None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:30.867678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-158325a3-02bc-44c7-b156-c4cbe7970173 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:30.868851 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-158325a3-02bc-44c7-b156-c4cbe7970173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:30.946949 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 425/874] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:30.966330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158325a3-02bc-44c7-b156-c4cbe7970173 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:30.983441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b402a45-fb6b-4e66-ae15-5ee761a3c6ce None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:31.032341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06515df0-5581-4abb-8400-67bd937e05e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:31.032941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06515df0-5581-4abb-8400-67bd937e05e8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:31.033471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06515df0-5581-4abb-8400-67bd937e05e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:31.033778 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06515df0-5581-4abb-8400-67bd937e05e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:31.036298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06515df0-5581-4abb-8400-67bd937e05e8 None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=2a5fd14de7794b14bd0a2a2a62a70762) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:31.036887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06515df0-5581-4abb-8400-67bd937e05e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:31.038604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06515df0-5581-4abb-8400-67bd937e05e8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:31.047202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 450/875] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:30 2022] GET /identity/v3/role_assignments?user.id=2a5fd14de7794b14bd0a2a2a62a70762&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:31.055799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:31.077296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158325a3-02bc-44c7-b156-c4cbe7970173 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:31.118807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace1df-cca6-43fe-8b3b-e87539e42227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:31.119834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace1df-cca6-43fe-8b3b-e87539e42227 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:31.120115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace1df-cca6-43fe-8b3b-e87539e42227 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:31.120388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ace1df-cca6-43fe-8b3b-e87539e42227 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:31.121052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ace1df-cca6-43fe-8b3b-e87539e42227 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:31.122447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ace1df-cca6-43fe-8b3b-e87539e42227 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-16ace1df-cca6-43fe-8b3b-e87539e42227 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:31.136256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:31.137321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:31.139277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 426/876] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:31.144041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06515df0-5581-4abb-8400-67bd937e05e8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:31.185257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:31.261592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06515df0-5581-4abb-8400-67bd937e05e8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:31.297789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da1b31-0bb6-474f-85a7-8bf7c55141b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:31.298865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da1b31-0bb6-474f-85a7-8bf7c55141b9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:31.299502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da1b31-0bb6-474f-85a7-8bf7c55141b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:31.300494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da1b31-0bb6-474f-85a7-8bf7c55141b9 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:31.301408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da1b31-0bb6-474f-85a7-8bf7c55141b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:31.301919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da1b31-0bb6-474f-85a7-8bf7c55141b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:31.303616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da1b31-0bb6-474f-85a7-8bf7c55141b9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:31.309291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 451/877] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:31.314532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace1df-cca6-43fe-8b3b-e87539e42227 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:31.420653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ace1df-cca6-43fe-8b3b-e87539e42227 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:31.459418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3a50b-b001-4bb1-9151-4337ea0a2b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:31.460084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a50b-b001-4bb1-9151-4337ea0a2b6d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:31.460363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a50b-b001-4bb1-9151-4337ea0a2b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:31.460633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a50b-b001-4bb1-9151-4337ea0a2b6d None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:31.461336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a50b-b001-4bb1-9151-4337ea0a2b6d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:31.461639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a50b-b001-4bb1-9151-4337ea0a2b6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:31.463029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a50b-b001-4bb1-9151-4337ea0a2b6d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:31.468225 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 427/878] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:31.621394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e0af-d3fc-4bd9-8ae7-2697a0bd1217 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:31.621714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e0af-d3fc-4bd9-8ae7-2697a0bd1217 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:31.621966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55e0af-d3fc-4bd9-8ae7-2697a0bd1217 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:31.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 452/879] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:31.630719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf497-c900-4c12-b0f6-f307e0686332 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:31.631221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf497-c900-4c12-b0f6-f307e0686332 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:31.631317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdf497-c900-4c12-b0f6-f307e0686332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:31.649571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-35cdf497-c900-4c12-b0f6-f307e0686332 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:31.650777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-35cdf497-c900-4c12-b0f6-f307e0686332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:31.654732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:31.724931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 428/880] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:31.749294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e0af-d3fc-4bd9-8ae7-2697a0bd1217 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:31.853723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:31.857809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55e0af-d3fc-4bd9-8ae7-2697a0bd1217 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:31.894753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df85510-64e4-4972-beb6-b6d0555b0a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:31.895468 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df85510-64e4-4972-beb6-b6d0555b0a9c None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:31.895977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df85510-64e4-4972-beb6-b6d0555b0a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:31.896261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df85510-64e4-4972-beb6-b6d0555b0a9c None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:31.897059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df85510-64e4-4972-beb6-b6d0555b0a9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:31.898444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df85510-64e4-4972-beb6-b6d0555b0a9c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:32.015209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 453/881] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:28:31 2022] POST /identity/v3/services => generated 269 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:32.129050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb89a-6b23-4f29-bf88-4978faa98a0b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:32.129354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb89a-6b23-4f29-bf88-4978faa98a0b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:32.129521 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb89a-6b23-4f29-bf88-4978faa98a0b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:32.131305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 429/882] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:32.137081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48396-fa49-4116-852a-e80e46b2a600 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:32.137373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48396-fa49-4116-852a-e80e46b2a600 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:32.137651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48396-fa49-4116-852a-e80e46b2a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:32.155602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7eb48396-fa49-4116-852a-e80e46b2a600 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:32.156825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7eb48396-fa49-4116-852a-e80e46b2a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:32.237548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 454/883] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:32.260828 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb89a-6b23-4f29-bf88-4978faa98a0b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:32.370442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb89a-6b23-4f29-bf88-4978faa98a0b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:32.408871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07826bd7-ab30-4a62-9057-9e8440fcb1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:32.410512 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07826bd7-ab30-4a62-9057-9e8440fcb1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:32.411033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07826bd7-ab30-4a62-9057-9e8440fcb1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:32.411511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07826bd7-ab30-4a62-9057-9e8440fcb1d0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:32.412436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07826bd7-ab30-4a62-9057-9e8440fcb1d0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:32.414061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07826bd7-ab30-4a62-9057-9e8440fcb1d0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-07826bd7-ab30-4a62-9057-9e8440fcb1d0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:32.427127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:32.428149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 09:28:32.429021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:32.431947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 430/884] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:28:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:32.438003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb48396-fa49-4116-852a-e80e46b2a600 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:32.530323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:32.547195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb48396-fa49-4116-852a-e80e46b2a600 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:32.587155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f8b04-c8e6-4734-8af7-0a79566b1f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:32.587828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f8b04-c8e6-4734-8af7-0a79566b1f48 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:32.588109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f8b04-c8e6-4734-8af7-0a79566b1f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:32.588379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f8b04-c8e6-4734-8af7-0a79566b1f48 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:32.589089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f8b04-c8e6-4734-8af7-0a79566b1f48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:32.589442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f8b04-c8e6-4734-8af7-0a79566b1f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:32.590879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f8b04-c8e6-4734-8af7-0a79566b1f48 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:32.596441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 455/885] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:28:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:32.601765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07826bd7-ab30-4a62-9057-9e8440fcb1d0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:32.606003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:32.719223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07826bd7-ab30-4a62-9057-9e8440fcb1d0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:32.755018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba37a68-88a3-42fe-b463-70a0193382d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:32.755689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba37a68-88a3-42fe-b463-70a0193382d2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:32.755979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba37a68-88a3-42fe-b463-70a0193382d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:32.756256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba37a68-88a3-42fe-b463-70a0193382d2 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:32.756962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba37a68-88a3-42fe-b463-70a0193382d2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:32.757271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba37a68-88a3-42fe-b463-70a0193382d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:32.758650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba37a68-88a3-42fe-b463-70a0193382d2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:32.763976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 431/886] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:28:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:32.769747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f8b04-c8e6-4734-8af7-0a79566b1f48 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:32.873257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f8b04-c8e6-4734-8af7-0a79566b1f48 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:32.909303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc407906-e174-46a0-b061-317396aca478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:32.910021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407906-e174-46a0-b061-317396aca478 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:32.910251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407906-e174-46a0-b061-317396aca478 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:32.910537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc407906-e174-46a0-b061-317396aca478 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:32.911352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc407906-e174-46a0-b061-317396aca478 None admin] RBAC: Adding query filter params (interface=public, service_id=594857021c06439f99521afc75a84fe0, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:32.911667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc407906-e174-46a0-b061-317396aca478 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:32.913035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc407906-e174-46a0-b061-317396aca478 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:32.918523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 456/887] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 09:28:32 2022] GET /identity/v3/endpoints?service_id=594857021c06439f99521afc75a84fe0&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:32.927932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba37a68-88a3-42fe-b463-70a0193382d2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:32.998546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:33.033163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba37a68-88a3-42fe-b463-70a0193382d2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:33.069253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78daf433-eacf-48ee-9f63-2733dc72b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:33.069933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daf433-eacf-48ee-9f63-2733dc72b2fd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:33.070221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daf433-eacf-48ee-9f63-2733dc72b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:33.070503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78daf433-eacf-48ee-9f63-2733dc72b2fd None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:33.071232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daf433-eacf-48ee-9f63-2733dc72b2fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:33.072618 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78daf433-eacf-48ee-9f63-2733dc72b2fd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:33.078905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 432/888] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 09:28:32 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:28:33.392233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d22f8-3e98-4720-9444-10e30447350c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:33.393805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d22f8-3e98-4720-9444-10e30447350c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:33.394330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d22f8-3e98-4720-9444-10e30447350c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:33.396163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 457/889] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:33.401704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8f879-0e65-4b34-ab06-77d0a1bc3a23 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:33.402263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8f879-0e65-4b34-ab06-77d0a1bc3a23 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:33.402748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8f879-0e65-4b34-ab06-77d0a1bc3a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:33.420575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e1a8f879-0e65-4b34-ab06-77d0a1bc3a23 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:33.422076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e1a8f879-0e65-4b34-ab06-77d0a1bc3a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:33.497476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 433/890] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:33.521689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d22f8-3e98-4720-9444-10e30447350c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:33.538481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:33.585938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557a87-b0e7-4827-9e0e-6a1d742ca67d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:33.586246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557a87-b0e7-4827-9e0e-6a1d742ca67d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:33.586626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed557a87-b0e7-4827-9e0e-6a1d742ca67d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:33.601938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 434/891] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:28:33.603790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938bb35-f18c-4c14-b36d-33f220fb64b9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:33.604281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938bb35-f18c-4c14-b36d-33f220fb64b9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:33.604754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938bb35-f18c-4c14-b36d-33f220fb64b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:33.624935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7938bb35-f18c-4c14-b36d-33f220fb64b9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:33.626506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7938bb35-f18c-4c14-b36d-33f220fb64b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:33.705134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d22f8-3e98-4720-9444-10e30447350c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:33.739270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:33.762028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 435/892] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:33.774767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797380c-adb7-4bcc-b960-3c5a83ec51ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:33.775923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797380c-adb7-4bcc-b960-3c5a83ec51ce None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:33.776359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797380c-adb7-4bcc-b960-3c5a83ec51ce None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:33.776871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797380c-adb7-4bcc-b960-3c5a83ec51ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:33.777996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938bb35-f18c-4c14-b36d-33f220fb64b9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:33.814787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797380c-adb7-4bcc-b960-3c5a83ec51ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-9797380c-adb7-4bcc-b960-3c5a83ec51ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:33.835323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:33.836283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:33.837112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:33.840997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 458/893] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 09:28:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:33.843503 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797380c-adb7-4bcc-b960-3c5a83ec51ce None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:33.936286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938bb35-f18c-4c14-b36d-33f220fb64b9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:33.974681 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e044079-51d5-4955-92a4-9468678ff3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:33.975311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e044079-51d5-4955-92a4-9468678ff3a3 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:33.975602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e044079-51d5-4955-92a4-9468678ff3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:33.975877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e044079-51d5-4955-92a4-9468678ff3a3 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:33.976643 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e044079-51d5-4955-92a4-9468678ff3a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:33.978026 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e044079-51d5-4955-92a4-9468678ff3a3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:33.999432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:34.035377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797380c-adb7-4bcc-b960-3c5a83ec51ce None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:34.058885 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 436/894] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:28:33 2022] POST /identity/v3/services => generated 241 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:28:34.093119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692b7e2-737f-46f2-a11b-1604c2cd6390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:34.093805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692b7e2-737f-46f2-a11b-1604c2cd6390 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.094115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692b7e2-737f-46f2-a11b-1604c2cd6390 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.094362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692b7e2-737f-46f2-a11b-1604c2cd6390 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.095151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692b7e2-737f-46f2-a11b-1604c2cd6390 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:34.095518 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692b7e2-737f-46f2-a11b-1604c2cd6390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:34.097058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692b7e2-737f-46f2-a11b-1604c2cd6390 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:34.107800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 459/895] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 09:28:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:34.114123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e044079-51d5-4955-92a4-9468678ff3a3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:34.177481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:34.233203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e044079-51d5-4955-92a4-9468678ff3a3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:34.234679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c11fb-69e3-4c13-a72e-f464896ab2ba None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.235021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c11fb-69e3-4c13-a72e-f464896ab2ba None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.235602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c11fb-69e3-4c13-a72e-f464896ab2ba None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.239488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 460/896] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:34.243970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37723-8790-4e35-b469-633f701b45a9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.244173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37723-8790-4e35-b469-633f701b45a9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.244398 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a37723-8790-4e35-b469-633f701b45a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.265411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f9a37723-8790-4e35-b469-633f701b45a9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:34.266608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f9a37723-8790-4e35-b469-633f701b45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:34.281918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789a2e-7d01-4539-95a1-1dd9e0ba47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:34.283090 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789a2e-7d01-4539-95a1-1dd9e0ba47b5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.283372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789a2e-7d01-4539-95a1-1dd9e0ba47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.283648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19789a2e-7d01-4539-95a1-1dd9e0ba47b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.298971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19789a2e-7d01-4539-95a1-1dd9e0ba47b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:34.301916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19789a2e-7d01-4539-95a1-1dd9e0ba47b5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-19789a2e-7d01-4539-95a1-1dd9e0ba47b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:34.324717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:34.325666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:34.326550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:34.326550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:34.326550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:34.326550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:34.326550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 437/897] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:34.332846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789a2e-7d01-4539-95a1-1dd9e0ba47b5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:34.358719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 461/898] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:34.388669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37723-8790-4e35-b469-633f701b45a9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:34.463013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19789a2e-7d01-4539-95a1-1dd9e0ba47b5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:34.466054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:34.473188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:34.504914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b522cd-b6fd-4066-a260-163bdfde8f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:34.505503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b522cd-b6fd-4066-a260-163bdfde8f77 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.505783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b522cd-b6fd-4066-a260-163bdfde8f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.506078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b522cd-b6fd-4066-a260-163bdfde8f77 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.507322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b522cd-b6fd-4066-a260-163bdfde8f77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:34.507837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b522cd-b6fd-4066-a260-163bdfde8f77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:34.509518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b522cd-b6fd-4066-a260-163bdfde8f77 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:34.520557 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a37723-8790-4e35-b469-633f701b45a9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:34.530224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 438/899] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:34.531146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b522cd-b6fd-4066-a260-163bdfde8f77 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:34.562415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c0d36-901a-4532-b65f-9e58884e1938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:34.563572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c0d36-901a-4532-b65f-9e58884e1938 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.563856 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c0d36-901a-4532-b65f-9e58884e1938 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.564302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c0d36-901a-4532-b65f-9e58884e1938 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.565868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c0d36-901a-4532-b65f-9e58884e1938 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:34.567585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c0d36-901a-4532-b65f-9e58884e1938 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-6a9c0d36-901a-4532-b65f-9e58884e1938 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:34.582428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:34.583455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 09:28:34.584289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:34.589837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 462/900] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Jun 24 09:28:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:34.590745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c0d36-901a-4532-b65f-9e58884e1938 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:34.677239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b522cd-b6fd-4066-a260-163bdfde8f77 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:34.710912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c0d36-901a-4532-b65f-9e58884e1938 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:34.723433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e3da-bcb2-4e22-8dd1-9671a1ab4979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:34.724582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e3da-bcb2-4e22-8dd1-9671a1ab4979 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.725032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e3da-bcb2-4e22-8dd1-9671a1ab4979 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.725762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e3da-bcb2-4e22-8dd1-9671a1ab4979 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.736772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288e3da-bcb2-4e22-8dd1-9671a1ab4979 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:34.739694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288e3da-bcb2-4e22-8dd1-9671a1ab4979 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:34.740771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:34.750468 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97264f1-dcce-495a-8d75-31e79fc5a170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:34.751308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97264f1-dcce-495a-8d75-31e79fc5a170 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.751659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97264f1-dcce-495a-8d75-31e79fc5a170 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.752008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97264f1-dcce-495a-8d75-31e79fc5a170 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.753446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97264f1-dcce-495a-8d75-31e79fc5a170 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:34.753823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97264f1-dcce-495a-8d75-31e79fc5a170 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:34.755406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97264f1-dcce-495a-8d75-31e79fc5a170 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-5288e3da-bcb2-4e22-8dd1-9671a1ab4979 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:34.761013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:34.762093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:34.763175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:34.769850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 463/901] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:34.769850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97264f1-dcce-495a-8d75-31e79fc5a170 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:34.770362 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 439/902] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:28:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:34.772133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e3da-bcb2-4e22-8dd1-9671a1ab4979 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:34.814292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:34.881127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97264f1-dcce-495a-8d75-31e79fc5a170 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:34.921653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288e3da-bcb2-4e22-8dd1-9671a1ab4979 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:34.923086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe8fbc-3a38-44a6-9854-d2ffb8a79d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:34.923756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe8fbc-3a38-44a6-9854-d2ffb8a79d5d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.924041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe8fbc-3a38-44a6-9854-d2ffb8a79d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.924433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe8fbc-3a38-44a6-9854-d2ffb8a79d5d None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.925058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe8fbc-3a38-44a6-9854-d2ffb8a79d5d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:34.925425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe8fbc-3a38-44a6-9854-d2ffb8a79d5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:34.926824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe8fbc-3a38-44a6-9854-d2ffb8a79d5d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:34.936955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 464/903] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:34.937843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe8fbc-3a38-44a6-9854-d2ffb8a79d5d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:34.969099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5bd52-e5b9-4a21-aad8-94ea1e3caa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:34.970826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5bd52-e5b9-4a21-aad8-94ea1e3caa02 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:34.972222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5bd52-e5b9-4a21-aad8-94ea1e3caa02 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:34.972714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5bd52-e5b9-4a21-aad8-94ea1e3caa02 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:34.973779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5bd52-e5b9-4a21-aad8-94ea1e3caa02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:34.974547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5bd52-e5b9-4a21-aad8-94ea1e3caa02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:34.977129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5bd52-e5b9-4a21-aad8-94ea1e3caa02 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:34.996567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:35.001997 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 440/904] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 09:28:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:35.012555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5bd52-e5b9-4a21-aad8-94ea1e3caa02 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:35.055578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe8fbc-3a38-44a6-9854-d2ffb8a79d5d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:35.092038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a763c4-f195-4aea-b569-eb3f32b86c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:35.092604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a763c4-f195-4aea-b569-eb3f32b86c23 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.092891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a763c4-f195-4aea-b569-eb3f32b86c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.093168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a763c4-f195-4aea-b569-eb3f32b86c23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.094022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a763c4-f195-4aea-b569-eb3f32b86c23 None admin] RBAC: Adding query filter params (interface=public, service_id=f606e68d333a496dba4307e4e028b166, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:35.094264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a763c4-f195-4aea-b569-eb3f32b86c23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:35.095680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a763c4-f195-4aea-b569-eb3f32b86c23 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:35.106705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 465/905] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 09:28:34 2022] GET /identity/v3/endpoints?service_id=f606e68d333a496dba4307e4e028b166&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:35.107611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a763c4-f195-4aea-b569-eb3f32b86c23 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:35.118756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:35.150160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5bd52-e5b9-4a21-aad8-94ea1e3caa02 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:35.197789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2d3b-4492-48e5-aa4e-2fe94d1e2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:35.198507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2d3b-4492-48e5-aa4e-2fe94d1e2952 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.198722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2d3b-4492-48e5-aa4e-2fe94d1e2952 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.199037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb2d3b-4492-48e5-aa4e-2fe94d1e2952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.219263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a763c4-f195-4aea-b569-eb3f32b86c23 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:35.240886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:35.259340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3323c-1697-4d26-9c8b-fa339fa6501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:35.260011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3323c-1697-4d26-9c8b-fa339fa6501a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.260301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3323c-1697-4d26-9c8b-fa339fa6501a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.260585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3323c-1697-4d26-9c8b-fa339fa6501a None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.261270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3323c-1697-4d26-9c8b-fa339fa6501a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:35.262688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3323c-1697-4d26-9c8b-fa339fa6501a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:35.278876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 466/906] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 09:28:35 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:28:35.278876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e820c1-809c-4ba3-9f6e-55389de84d8f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.278876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e820c1-809c-4ba3-9f6e-55389de84d8f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.278876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e820c1-809c-4ba3-9f6e-55389de84d8f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.278876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 467/907] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:35.278876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f0a1b-4fc8-4f6b-9531-989499c2b806 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.278876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f0a1b-4fc8-4f6b-9531-989499c2b806 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.279543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f0a1b-4fc8-4f6b-9531-989499c2b806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.285230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2d3b-4492-48e5-aa4e-2fe94d1e2952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:35.286980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb2d3b-4492-48e5-aa4e-2fe94d1e2952 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:35.297467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-840f0a1b-4fc8-4f6b-9531-989499c2b806 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:35.298806 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-840f0a1b-4fc8-4f6b-9531-989499c2b806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:35.385675 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 468/908] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:35.395370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:35.409792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f0a1b-4fc8-4f6b-9531-989499c2b806 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:35.420299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 441/909] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:35 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 09:28:35.426067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2d3b-4492-48e5-aa4e-2fe94d1e2952 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:35.527665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f0a1b-4fc8-4f6b-9531-989499c2b806 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:35.541864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:35.546795 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb2d3b-4492-48e5-aa4e-2fe94d1e2952 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:35.563859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b8b55-f1cc-47b2-b04f-a2aaaf40c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:35.564816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b8b55-f1cc-47b2-b04f-a2aaaf40c1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.565208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b8b55-f1cc-47b2-b04f-a2aaaf40c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.565556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b8b55-f1cc-47b2-b04f-a2aaaf40c1a9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.566294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b8b55-f1cc-47b2-b04f-a2aaaf40c1a9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:35.567775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b8b55-f1cc-47b2-b04f-a2aaaf40c1a9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-7e1b8b55-f1cc-47b2-b04f-a2aaaf40c1a9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:35.583351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:35.584626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 09:28:35.585699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:35.587337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 469/910] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:28:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:35.596177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b8b55-f1cc-47b2-b04f-a2aaaf40c1a9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:35.614826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac862a-f3be-4166-bd47-ebe35370441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:35.616058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac862a-f3be-4166-bd47-ebe35370441e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.616551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac862a-f3be-4166-bd47-ebe35370441e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.617108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac862a-f3be-4166-bd47-ebe35370441e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.629663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac862a-f3be-4166-bd47-ebe35370441e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:35.631515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac862a-f3be-4166-bd47-ebe35370441e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b8ac862a-f3be-4166-bd47-ebe35370441e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:35.652198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:35.653177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:35.654108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:35.654108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:35.654108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:35.654108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:35.656537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 442/911] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:35.663030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac862a-f3be-4166-bd47-ebe35370441e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:35.702301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b8b55-f1cc-47b2-b04f-a2aaaf40c1a9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:35.705354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:35.746798 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d643f-3990-49f2-9691-fc3281cf0724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:35.748243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d643f-3990-49f2-9691-fc3281cf0724 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.748953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d643f-3990-49f2-9691-fc3281cf0724 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.749446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d643f-3990-49f2-9691-fc3281cf0724 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.750715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d643f-3990-49f2-9691-fc3281cf0724 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:35.751315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d643f-3990-49f2-9691-fc3281cf0724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:35.753709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d643f-3990-49f2-9691-fc3281cf0724 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:35.761947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 470/912] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:28:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:35.770479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d643f-3990-49f2-9691-fc3281cf0724 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:35.791417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac862a-f3be-4166-bd47-ebe35370441e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:35.820933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:35.831938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a7244-3b6d-4f41-80c7-0e048e712e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:35.832888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a7244-3b6d-4f41-80c7-0e048e712e6e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.833344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a7244-3b6d-4f41-80c7-0e048e712e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.833843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a7244-3b6d-4f41-80c7-0e048e712e6e None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.836740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a7244-3b6d-4f41-80c7-0e048e712e6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:35.836740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a7244-3b6d-4f41-80c7-0e048e712e6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:35.836740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a7244-3b6d-4f41-80c7-0e048e712e6e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:35.849810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 443/913] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:35.854951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a7244-3b6d-4f41-80c7-0e048e712e6e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:35.902163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d643f-3990-49f2-9691-fc3281cf0724 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:35.948370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653a5b0-b673-4b59-b0a8-93c7396ddcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:35.949756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653a5b0-b673-4b59-b0a8-93c7396ddcea None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:35.950238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653a5b0-b673-4b59-b0a8-93c7396ddcea None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:35.950744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653a5b0-b673-4b59-b0a8-93c7396ddcea None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:35.951683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653a5b0-b673-4b59-b0a8-93c7396ddcea None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:35.952661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653a5b0-b673-4b59-b0a8-93c7396ddcea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:35.954742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8653a5b0-b673-4b59-b0a8-93c7396ddcea None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:35.959739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:35.965160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 471/914] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 09:28:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:35.968966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a7244-3b6d-4f41-80c7-0e048e712e6e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:35.971135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653a5b0-b673-4b59-b0a8-93c7396ddcea None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:36.006035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c98d3-4b18-4b96-84b6-d2ea5e3e97f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:36.006831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c98d3-4b18-4b96-84b6-d2ea5e3e97f3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:36.007146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c98d3-4b18-4b96-84b6-d2ea5e3e97f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:36.007423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c98d3-4b18-4b96-84b6-d2ea5e3e97f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:36.016639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c98d3-4b18-4b96-84b6-d2ea5e3e97f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:36.018090 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c98d3-4b18-4b96-84b6-d2ea5e3e97f3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-7b0c98d3-4b18-4b96-84b6-d2ea5e3e97f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:36.032944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:36.034000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:36.035699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:36.035699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:36.035699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:36.035699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:36.035699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:36.035699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:36.035699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:36.035699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:36.039323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 444/915] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:36.040129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c98d3-4b18-4b96-84b6-d2ea5e3e97f3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:36.113454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8653a5b0-b673-4b59-b0a8-93c7396ddcea None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:36.116510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:36.154287 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c98d3-4b18-4b96-84b6-d2ea5e3e97f3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:36.160174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b7f7f-61b0-4d2f-8e57-f1e5eccc6ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:36.161101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b7f7f-61b0-4d2f-8e57-f1e5eccc6ac3 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:36.162052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b7f7f-61b0-4d2f-8e57-f1e5eccc6ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:36.162563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b7f7f-61b0-4d2f-8e57-f1e5eccc6ac3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:36.163964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b7f7f-61b0-4d2f-8e57-f1e5eccc6ac3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:36.166213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b7f7f-61b0-4d2f-8e57-f1e5eccc6ac3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:36.192009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72c3db-ab0b-4916-94b3-daf382379dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:36.196666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c3db-ab0b-4916-94b3-daf382379dab None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:36.196666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c3db-ab0b-4916-94b3-daf382379dab None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:36.196666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72c3db-ab0b-4916-94b3-daf382379dab None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:36.196666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72c3db-ab0b-4916-94b3-daf382379dab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:36.196666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72c3db-ab0b-4916-94b3-daf382379dab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:36.196666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72c3db-ab0b-4916-94b3-daf382379dab None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:36.208961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 445/916] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:36.210272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb3b90-27ea-4668-af47-d84b47b04cfb None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:36.210568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb3b90-27ea-4668-af47-d84b47b04cfb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:36.210863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb3b90-27ea-4668-af47-d84b47b04cfb None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:36.212208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 446/917] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:36.214610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb3b90-27ea-4668-af47-d84b47b04cfb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:36.231000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:36.250892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 472/918] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 09:28:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:36.250892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302a01-e5ed-47af-81b2-c92a69db26a0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:36.250892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302a01-e5ed-47af-81b2-c92a69db26a0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:36.250892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64302a01-e5ed-47af-81b2-c92a69db26a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:36.273357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-64302a01-e5ed-47af-81b2-c92a69db26a0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:36.274696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-64302a01-e5ed-47af-81b2-c92a69db26a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:36.357919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb3b90-27ea-4668-af47-d84b47b04cfb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:36.365562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 473/919] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:36.388883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64302a01-e5ed-47af-81b2-c92a69db26a0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:36.403648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02f19d-3cae-4c0f-8f89-8cb64409fe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:36.404334 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02f19d-3cae-4c0f-8f89-8cb64409fe9d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:36.404623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02f19d-3cae-4c0f-8f89-8cb64409fe9d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:36.404905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02f19d-3cae-4c0f-8f89-8cb64409fe9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:36.405752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02f19d-3cae-4c0f-8f89-8cb64409fe9d None admin] RBAC: Adding query filter params (role.id=4e20c7e459304902a6face48dac75f06, scope.project.id=0ec77816151b45228e087023588839da, user.id=2a5fd14de7794b14bd0a2a2a62a70762) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:36.406072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02f19d-3cae-4c0f-8f89-8cb64409fe9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:36.408189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02f19d-3cae-4c0f-8f89-8cb64409fe9d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:36.416532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 447/920] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:36 2022] GET /identity/v3/role_assignments?user.id=2a5fd14de7794b14bd0a2a2a62a70762&scope.project.id=0ec77816151b45228e087023588839da&role.id=4e20c7e459304902a6face48dac75f06 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:36.524635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:36.533527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64302a01-e5ed-47af-81b2-c92a69db26a0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:36.572493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89282257-37c8-49bc-b379-63d115a8e9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:36.573842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282257-37c8-49bc-b379-63d115a8e9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:36.580066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282257-37c8-49bc-b379-63d115a8e9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:36.580634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89282257-37c8-49bc-b379-63d115a8e9a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:36.581536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89282257-37c8-49bc-b379-63d115a8e9a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:36.583263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89282257-37c8-49bc-b379-63d115a8e9a0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-89282257-37c8-49bc-b379-63d115a8e9a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:36.602304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:36.603413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:36.604470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:36.607015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 474/921] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:36.614880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02f19d-3cae-4c0f-8f89-8cb64409fe9d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:36.694788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:36.721136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02f19d-3cae-4c0f-8f89-8cb64409fe9d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:36.756294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac5a1c-0ee7-4875-bf0f-f31d86b14ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:36.756963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac5a1c-0ee7-4875-bf0f-f31d86b14ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:36.757239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac5a1c-0ee7-4875-bf0f-f31d86b14ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:36.757553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac5a1c-0ee7-4875-bf0f-f31d86b14ef1 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:36.758265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac5a1c-0ee7-4875-bf0f-f31d86b14ef1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:36.758567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac5a1c-0ee7-4875-bf0f-f31d86b14ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:36.760032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac5a1c-0ee7-4875-bf0f-f31d86b14ef1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:36.765286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 448/922] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:36.771827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89282257-37c8-49bc-b379-63d115a8e9a0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:36.880180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89282257-37c8-49bc-b379-63d115a8e9a0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:36.918507 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e14ae7-e050-4234-82bf-a8b9f554c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:36.919529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e14ae7-e050-4234-82bf-a8b9f554c2fd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:36.919991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e14ae7-e050-4234-82bf-a8b9f554c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:36.920440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e14ae7-e050-4234-82bf-a8b9f554c2fd None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:36.921323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e14ae7-e050-4234-82bf-a8b9f554c2fd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:36.921802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e14ae7-e050-4234-82bf-a8b9f554c2fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:36.923382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e14ae7-e050-4234-82bf-a8b9f554c2fd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:36.937087 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 475/923] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:36.943871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac5a1c-0ee7-4875-bf0f-f31d86b14ef1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:37.054222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac5a1c-0ee7-4875-bf0f-f31d86b14ef1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:37.089134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc2b1c-2384-40ec-bcbe-15f458705e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:37.089798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2b1c-2384-40ec-bcbe-15f458705e5e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:37.090099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2b1c-2384-40ec-bcbe-15f458705e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:37.090349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc2b1c-2384-40ec-bcbe-15f458705e5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:37.091172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc2b1c-2384-40ec-bcbe-15f458705e5e None admin] RBAC: Adding query filter params (interface=public, service_id=6e71d3c5c01745e690dc72ef4e54253d, region_id=RegionOne) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:37.091481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc2b1c-2384-40ec-bcbe-15f458705e5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:37.092851 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc2b1c-2384-40ec-bcbe-15f458705e5e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:37.098994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 449/924] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 09:28:36 2022] GET /identity/v3/endpoints?service_id=6e71d3c5c01745e690dc72ef4e54253d&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:37.108336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e14ae7-e050-4234-82bf-a8b9f554c2fd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:37.131071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:37.213403 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e14ae7-e050-4234-82bf-a8b9f554c2fd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:37.249627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daabcda-199f-4093-a826-cd37f2ce9160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:37.250646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daabcda-199f-4093-a826-cd37f2ce9160 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:37.251192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daabcda-199f-4093-a826-cd37f2ce9160 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:37.251678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daabcda-199f-4093-a826-cd37f2ce9160 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:37.252746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daabcda-199f-4093-a826-cd37f2ce9160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:37.254346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daabcda-199f-4093-a826-cd37f2ce9160 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:37.267003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 476/925] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 09:28:37 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:28:37.416167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda48898-412a-42b9-9473-104fec190bd4 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:37.416820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda48898-412a-42b9-9473-104fec190bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:37.417313 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda48898-412a-42b9-9473-104fec190bd4 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:37.419230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 450/926] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:37.424133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a9929-17ab-4c9f-983d-722db3a07521 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:37.424466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a9929-17ab-4c9f-983d-722db3a07521 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:37.424755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063a9929-17ab-4c9f-983d-722db3a07521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:37.442201 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-063a9929-17ab-4c9f-983d-722db3a07521 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:37.443427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-063a9929-17ab-4c9f-983d-722db3a07521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:37.520451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 477/927] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:37.543366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda48898-412a-42b9-9473-104fec190bd4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:37.546277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:37.656727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda48898-412a-42b9-9473-104fec190bd4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:37.692156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd48b8b-6dd5-4433-82cc-d2ac75a399b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:37.692895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd48b8b-6dd5-4433-82cc-d2ac75a399b4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:37.693178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd48b8b-6dd5-4433-82cc-d2ac75a399b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:37.693457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd48b8b-6dd5-4433-82cc-d2ac75a399b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:37.694101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd48b8b-6dd5-4433-82cc-d2ac75a399b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:37.695597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd48b8b-6dd5-4433-82cc-d2ac75a399b4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-0cd48b8b-6dd5-4433-82cc-d2ac75a399b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:37.708196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:37.709143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:37.710131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 451/928] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Jun 24 09:28:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:37.715414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a9929-17ab-4c9f-983d-722db3a07521 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:37.731179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:37.823748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063a9929-17ab-4c9f-983d-722db3a07521 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:37.857797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76af12b-ca26-4117-b569-e4e7bbeaef99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:37.858469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af12b-ca26-4117-b569-e4e7bbeaef99 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:37.858753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af12b-ca26-4117-b569-e4e7bbeaef99 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:37.859056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76af12b-ca26-4117-b569-e4e7bbeaef99 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:37.859767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76af12b-ca26-4117-b569-e4e7bbeaef99 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:37.860074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76af12b-ca26-4117-b569-e4e7bbeaef99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:37.861696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76af12b-ca26-4117-b569-e4e7bbeaef99 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:37.867716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 478/929] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:37.872958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd48b8b-6dd5-4433-82cc-d2ac75a399b4 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:37.946428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:37.983816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd48b8b-6dd5-4433-82cc-d2ac75a399b4 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:38.020867 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc870a3-9b68-428f-a644-44b1b8734a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:38.021548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc870a3-9b68-428f-a644-44b1b8734a1d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:38.021829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc870a3-9b68-428f-a644-44b1b8734a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:38.022103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc870a3-9b68-428f-a644-44b1b8734a1d None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:38.022811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc870a3-9b68-428f-a644-44b1b8734a1d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:38.023145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc870a3-9b68-428f-a644-44b1b8734a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:38.024519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc870a3-9b68-428f-a644-44b1b8734a1d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:38.029888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 452/930] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:38.036212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76af12b-ca26-4117-b569-e4e7bbeaef99 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:38.123563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:38.148127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76af12b-ca26-4117-b569-e4e7bbeaef99 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:38.182763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae52bb-80bd-4c2f-961b-c45ef2d61613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:38.183447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae52bb-80bd-4c2f-961b-c45ef2d61613 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:38.183729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae52bb-80bd-4c2f-961b-c45ef2d61613 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:38.184002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae52bb-80bd-4c2f-961b-c45ef2d61613 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:38.184740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae52bb-80bd-4c2f-961b-c45ef2d61613 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:38.186094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae52bb-80bd-4c2f-961b-c45ef2d61613 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:38.284111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 479/931] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 09:28:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:38.465863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166120-561c-47ad-b2b3-6098567bd561 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:38.466318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166120-561c-47ad-b2b3-6098567bd561 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:38.466603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a166120-561c-47ad-b2b3-6098567bd561 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:38.468043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 453/932] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:38.474969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01dc6-93b3-4676-b091-d47ff62d4276 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:38.475295 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01dc6-93b3-4676-b091-d47ff62d4276 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:38.475533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da01dc6-93b3-4676-b091-d47ff62d4276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:38.495107 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3da01dc6-93b3-4676-b091-d47ff62d4276 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:38.496313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3da01dc6-93b3-4676-b091-d47ff62d4276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:38.561382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a594a-160f-4730-9e2c-957b59ff0eb9 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:38.561687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a594a-160f-4730-9e2c-957b59ff0eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:38.561859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a594a-160f-4730-9e2c-957b59ff0eb9 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:38.563482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 454/933] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:38.568759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac042f11-b22e-41ec-a15a-5ea6dd8e5442 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:38.569219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac042f11-b22e-41ec-a15a-5ea6dd8e5442 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:38.569647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac042f11-b22e-41ec-a15a-5ea6dd8e5442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:38.575172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 480/934] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:38.598249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ac042f11-b22e-41ec-a15a-5ea6dd8e5442 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:38.598497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da01dc6-93b3-4676-b091-d47ff62d4276 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:38.599900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ac042f11-b22e-41ec-a15a-5ea6dd8e5442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:38.664395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:38.683019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 455/935] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:38.706657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac042f11-b22e-41ec-a15a-5ea6dd8e5442 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:38.712568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da01dc6-93b3-4676-b091-d47ff62d4276 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:38.748402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:38.749819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:38.750314 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:38.750770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:38.751691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:38.754347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:38.756067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING keystone.server.flask.common [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 09:28:38.772810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:38.808691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.sql.core [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 09:28:38.808691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 09:28:38.808691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [parameters: {'id': '04bc5b8e65f644f293913e026d62204f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 09:28:38.808691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80512) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 09:28:38.818946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac042f11-b22e-41ec-a15a-5ea6dd8e5442 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 04bc5b8e65f644f293913e026d62204f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 04bc5b8e65f644f293913e026d62204f. Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application conn.query(q) Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 09:28:38.819717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result.read() Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 09:28:38.820528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application next(self.gen) Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application yield resource Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application next(self.gen) Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise self.value Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application session.commit() Jun 24 09:28:38.821494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.session.flush() Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application compat.raise_( Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 09:28:38.822385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 09:28:38.823404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application conn.query(q) Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result.read() Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 09:28:38.825490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [parameters: {'id': '04bc5b8e65f644f293913e026d62204f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:38.827933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:38.829854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 04bc5b8e65f644f293913e026d62204f. Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:38.832138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 481/936] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Jun 24 09:28:38 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:38.836686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:38.865516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a2bb-0931-4847-b703-8f3877a37e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:38.867213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a2bb-0931-4847-b703-8f3877a37e7e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:38.867683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a2bb-0931-4847-b703-8f3877a37e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:38.868307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a2bb-0931-4847-b703-8f3877a37e7e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:38.883152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092a2bb-0931-4847-b703-8f3877a37e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a092a2bb-0931-4847-b703-8f3877a37e7e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:38.894799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:38.895769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:38.896657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:38.904264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 456/937] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 09:28:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:38.905444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a2bb-0931-4847-b703-8f3877a37e7e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:38.950979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11330e0-e05a-41cc-9ed4-95ee236d2b2f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:38.987924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18234da9-befa-4578-a544-b82838cd1666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:38.988828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18234da9-befa-4578-a544-b82838cd1666 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:38.989167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18234da9-befa-4578-a544-b82838cd1666 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:38.989449 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18234da9-befa-4578-a544-b82838cd1666 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:38.996674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18234da9-befa-4578-a544-b82838cd1666 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:38.998284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18234da9-befa-4578-a544-b82838cd1666 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:38.999265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-18234da9-befa-4578-a544-b82838cd1666 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:39.016799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:39.017731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:39.019163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:39.019163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:39.019163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:39.019163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:39.019163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:39.019163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:39.019163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:39.019163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:39.023538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 482/938] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:39.025452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18234da9-befa-4578-a544-b82838cd1666 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:39.038555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a2bb-0931-4847-b703-8f3877a37e7e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:39.065081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:39.083268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ece018-5874-4d18-9392-9dfd91d98141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:39.084280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ece018-5874-4d18-9392-9dfd91d98141 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.084746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ece018-5874-4d18-9392-9dfd91d98141 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.085242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ece018-5874-4d18-9392-9dfd91d98141 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.086650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ece018-5874-4d18-9392-9dfd91d98141 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:39.087160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ece018-5874-4d18-9392-9dfd91d98141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:39.089170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ece018-5874-4d18-9392-9dfd91d98141 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:39.105626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 457/939] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 09:28:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:39.107350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ece018-5874-4d18-9392-9dfd91d98141 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:39.169939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18234da9-befa-4578-a544-b82838cd1666 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:39.216415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6eb71-ffa1-49d6-93e5-bd32f88233d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:39.217291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6eb71-ffa1-49d6-93e5-bd32f88233d5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.217681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6eb71-ffa1-49d6-93e5-bd32f88233d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.217967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6eb71-ffa1-49d6-93e5-bd32f88233d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.218733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6eb71-ffa1-49d6-93e5-bd32f88233d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:39.219086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6eb71-ffa1-49d6-93e5-bd32f88233d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:39.221861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6eb71-ffa1-49d6-93e5-bd32f88233d5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:39.230074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ece018-5874-4d18-9392-9dfd91d98141 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:39.254974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 483/940] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:39.270508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72debd88-49d2-4f6d-83a8-2cf51ea145f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:39.271732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debd88-49d2-4f6d-83a8-2cf51ea145f9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.272264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debd88-49d2-4f6d-83a8-2cf51ea145f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.272742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72debd88-49d2-4f6d-83a8-2cf51ea145f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.285779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72debd88-49d2-4f6d-83a8-2cf51ea145f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:39.287693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72debd88-49d2-4f6d-83a8-2cf51ea145f9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-72debd88-49d2-4f6d-83a8-2cf51ea145f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:39.307790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:39.308746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:39.309614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:39.309614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:39.309614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:39.309614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:39.312139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 458/941] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:39.319277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6eb71-ffa1-49d6-93e5-bd32f88233d5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:39.358762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:39.432445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6eb71-ffa1-49d6-93e5-bd32f88233d5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:39.443715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072684b2-444a-47b2-b9f2-328d1b108d8a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.444069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072684b2-444a-47b2-b9f2-328d1b108d8a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.444284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072684b2-444a-47b2-b9f2-328d1b108d8a None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.445793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 459/942] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:39.451335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6aa2b-8b67-49d5-84c7-6e72924344bc None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.451628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6aa2b-8b67-49d5-84c7-6e72924344bc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.451915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6aa2b-8b67-49d5-84c7-6e72924344bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.474100 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bbf6aa2b-8b67-49d5-84c7-6e72924344bc None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:39.475431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bbf6aa2b-8b67-49d5-84c7-6e72924344bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:39.477850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba161f-204d-4441-95ee-26c40df72bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:39.479195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba161f-204d-4441-95ee-26c40df72bdf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.479499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba161f-204d-4441-95ee-26c40df72bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.482877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba161f-204d-4441-95ee-26c40df72bdf None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.482877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba161f-204d-4441-95ee-26c40df72bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:39.482877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba161f-204d-4441-95ee-26c40df72bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:39.482877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba161f-204d-4441-95ee-26c40df72bdf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:39.495814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 484/943] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:39.504103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba161f-204d-4441-95ee-26c40df72bdf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:39.508016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:39.566963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 460/944] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:39.585496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6aa2b-8b67-49d5-84c7-6e72924344bc None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:39.631947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba161f-204d-4441-95ee-26c40df72bdf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:39.635945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:39.668160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30251-3c6c-4e49-8d24-693c7a65eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:39.669261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30251-3c6c-4e49-8d24-693c7a65eb5a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.669652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30251-3c6c-4e49-8d24-693c7a65eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.669939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a30251-3c6c-4e49-8d24-693c7a65eb5a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.679279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30251-3c6c-4e49-8d24-693c7a65eb5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:39.680943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a30251-3c6c-4e49-8d24-693c7a65eb5a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:39.696761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6aa2b-8b67-49d5-84c7-6e72924344bc None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-52a30251-3c6c-4e49-8d24-693c7a65eb5a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:39.697418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:39.698919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:39.700234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 485/945] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:28:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:39.707857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30251-3c6c-4e49-8d24-693c7a65eb5a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:39.745755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca9a33-af36-4490-9f74-ce060a604510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:39.746868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca9a33-af36-4490-9f74-ce060a604510 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.747165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca9a33-af36-4490-9f74-ce060a604510 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.747447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca9a33-af36-4490-9f74-ce060a604510 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.748574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca9a33-af36-4490-9f74-ce060a604510 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:39.750225 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca9a33-af36-4490-9f74-ce060a604510 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d9ca9a33-af36-4490-9f74-ce060a604510 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:39.767772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:39.769393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:39.770527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 461/946] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:39.780715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca9a33-af36-4490-9f74-ce060a604510 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:39.839262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:39.841813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a30251-3c6c-4e49-8d24-693c7a65eb5a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:39.886382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9b898-2e6b-4785-bd33-3ef27f9a2455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:39.887114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9b898-2e6b-4785-bd33-3ef27f9a2455 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.887482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9b898-2e6b-4785-bd33-3ef27f9a2455 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.887838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9b898-2e6b-4785-bd33-3ef27f9a2455 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.889215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9b898-2e6b-4785-bd33-3ef27f9a2455 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:39.889609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9b898-2e6b-4785-bd33-3ef27f9a2455 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:39.891530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff9b898-2e6b-4785-bd33-3ef27f9a2455 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:39.901700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca9a33-af36-4490-9f74-ce060a604510 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:39.919004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 486/947] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 09:28:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:39.921733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9b898-2e6b-4785-bd33-3ef27f9a2455 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:39.939384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:39.957602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e3ac-2c9f-4dba-8d18-48935ff2bb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:39.958805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e3ac-2c9f-4dba-8d18-48935ff2bb05 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:39.959307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e3ac-2c9f-4dba-8d18-48935ff2bb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:39.959805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345e3ac-2c9f-4dba-8d18-48935ff2bb05 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:39.960860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345e3ac-2c9f-4dba-8d18-48935ff2bb05 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:39.962124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345e3ac-2c9f-4dba-8d18-48935ff2bb05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:39.963751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345e3ac-2c9f-4dba-8d18-48935ff2bb05 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:39.970285 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 462/948] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:39.979852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e3ac-2c9f-4dba-8d18-48935ff2bb05 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:40.034198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9b898-2e6b-4785-bd33-3ef27f9a2455 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:40.073410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf794a53-3618-4082-9a21-7a24e3760f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:40.074215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf794a53-3618-4082-9a21-7a24e3760f00 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.074504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf794a53-3618-4082-9a21-7a24e3760f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.074784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf794a53-3618-4082-9a21-7a24e3760f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.087223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf794a53-3618-4082-9a21-7a24e3760f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:40.088751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf794a53-3618-4082-9a21-7a24e3760f00 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:40.091451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:40.100406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345e3ac-2c9f-4dba-8d18-48935ff2bb05 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-cf794a53-3618-4082-9a21-7a24e3760f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:40.109354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:40.111326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:40.112365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:40.112365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:40.112365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:40.112365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:40.113814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 487/949] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:40.119086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf794a53-3618-4082-9a21-7a24e3760f00 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:40.144948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e93e91-205e-4abf-9932-4816ee9cfb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:40.145393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93e91-205e-4abf-9932-4816ee9cfb43 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.145783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93e91-205e-4abf-9932-4816ee9cfb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.146183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e93e91-205e-4abf-9932-4816ee9cfb43 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.147032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93e91-205e-4abf-9932-4816ee9cfb43 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:40.147449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93e91-205e-4abf-9932-4816ee9cfb43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:40.148934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e93e91-205e-4abf-9932-4816ee9cfb43 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:40.159139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 463/950] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:40.160156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e93e91-205e-4abf-9932-4816ee9cfb43 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:40.194520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:40.237570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf794a53-3618-4082-9a21-7a24e3760f00 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:40.265084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e93e91-205e-4abf-9932-4816ee9cfb43 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:40.278170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82451006-e72c-4dbc-8b5b-10846e4997a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:40.279207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82451006-e72c-4dbc-8b5b-10846e4997a0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.279758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82451006-e72c-4dbc-8b5b-10846e4997a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.280366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82451006-e72c-4dbc-8b5b-10846e4997a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.281432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82451006-e72c-4dbc-8b5b-10846e4997a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:40.281944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82451006-e72c-4dbc-8b5b-10846e4997a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:40.283633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82451006-e72c-4dbc-8b5b-10846e4997a0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:40.301874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 488/951] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:40.302041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc9ed6-d2bd-4630-aa14-84f1b7f74479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:40.302663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9ed6-d2bd-4630-aa14-84f1b7f74479 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.302997 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9ed6-d2bd-4630-aa14-84f1b7f74479 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.303280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc9ed6-d2bd-4630-aa14-84f1b7f74479 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.304028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc9ed6-d2bd-4630-aa14-84f1b7f74479 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:40.304396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82451006-e72c-4dbc-8b5b-10846e4997a0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:40.305529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc9ed6-d2bd-4630-aa14-84f1b7f74479 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:40.367021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 464/952] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 09:28:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:40.411677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b864c-2457-4d07-95c5-4ecf65303989 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.412314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b864c-2457-4d07-95c5-4ecf65303989 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.412811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b864c-2457-4d07-95c5-4ecf65303989 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.414759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 465/953] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:28:40.420635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d644-a092-463d-b6f5-2aa50d2a7ca9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.420916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d644-a092-463d-b6f5-2aa50d2a7ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.421191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8d644-a092-463d-b6f5-2aa50d2a7ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.436512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82451006-e72c-4dbc-8b5b-10846e4997a0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:40.439825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5dd8d644-a092-463d-b6f5-2aa50d2a7ca9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:40.441751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5dd8d644-a092-463d-b6f5-2aa50d2a7ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:40.449969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:40.467379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:40.492065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106407e-fefd-4d75-9e54-3c52d3b0ddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:40.492882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106407e-fefd-4d75-9e54-3c52d3b0ddd0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.493167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106407e-fefd-4d75-9e54-3c52d3b0ddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.493446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106407e-fefd-4d75-9e54-3c52d3b0ddd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.501266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106407e-fefd-4d75-9e54-3c52d3b0ddd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:40.502773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106407e-fefd-4d75-9e54-3c52d3b0ddd0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2106407e-fefd-4d75-9e54-3c52d3b0ddd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:40.521610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:40.525582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:40.526563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:40.526563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:40.526563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:40.526563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:40.526563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:40.526563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:40.526563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:40.526563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:40.527832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 489/954] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:40.529190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106407e-fefd-4d75-9e54-3c52d3b0ddd0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:40.539129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 466/955] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:40.566055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d644-a092-463d-b6f5-2aa50d2a7ca9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:40.667137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106407e-fefd-4d75-9e54-3c52d3b0ddd0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:40.689756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8d644-a092-463d-b6f5-2aa50d2a7ca9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:40.716264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b035a-ccef-41b7-a234-2544314376bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:40.719175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b035a-ccef-41b7-a234-2544314376bb None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.719175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b035a-ccef-41b7-a234-2544314376bb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.719175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b035a-ccef-41b7-a234-2544314376bb None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.719471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b035a-ccef-41b7-a234-2544314376bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:40.719989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b035a-ccef-41b7-a234-2544314376bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:40.722252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b035a-ccef-41b7-a234-2544314376bb None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:40.729178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a14e-0886-440e-b233-fc7472a3182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:40.730224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a14e-0886-440e-b233-fc7472a3182f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.730733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a14e-0886-440e-b233-fc7472a3182f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.731287 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2a14e-0886-440e-b233-fc7472a3182f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.732141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2a14e-0886-440e-b233-fc7472a3182f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:40.733712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2a14e-0886-440e-b233-fc7472a3182f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:40.736429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 490/956] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:40.743913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b035a-ccef-41b7-a234-2544314376bb None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-2ef2a14e-0886-440e-b233-fc7472a3182f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:40.747761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:40.748808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 09:28:40.749785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:40.757958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 467/957] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:40.759220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a14e-0886-440e-b233-fc7472a3182f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:40.789483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:40.791222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:40.870581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b035a-ccef-41b7-a234-2544314376bb None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:40.876242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2a14e-0886-440e-b233-fc7472a3182f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:40.916230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105df5f-f5a4-4887-aede-3a29304dd433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:40.917283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105df5f-f5a4-4887-aede-3a29304dd433 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.917506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105df5f-f5a4-4887-aede-3a29304dd433 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.917914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105df5f-f5a4-4887-aede-3a29304dd433 None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/2a5fd14de7794b14bd0a2a2a62a70762/roles/4e20c7e459304902a6face48dac75f06` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.918605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec771d8-c1da-480c-8803-e0f5a4b6e788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:40.919691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec771d8-c1da-480c-8803-e0f5a4b6e788 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:40.920173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec771d8-c1da-480c-8803-e0f5a4b6e788 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:40.920436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105df5f-f5a4-4887-aede-3a29304dd433 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=2a5fd14de7794b14bd0a2a2a62a70762, role_id=4e20c7e459304902a6face48dac75f06)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:40.920831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec771d8-c1da-480c-8803-e0f5a4b6e788 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:40.921727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec771d8-c1da-480c-8803-e0f5a4b6e788 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:40.922048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105df5f-f5a4-4887-aede-3a29304dd433 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:40.922415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec771d8-c1da-480c-8803-e0f5a4b6e788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:40.923988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec771d8-c1da-480c-8803-e0f5a4b6e788 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:40.930283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 468/958] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:40.935940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec771d8-c1da-480c-8803-e0f5a4b6e788 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:41.011195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 491/959] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:40 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/2a5fd14de7794b14bd0a2a2a62a70762/roles/4e20c7e459304902a6face48dac75f06 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:41.028034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:41.053237 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec771d8-c1da-480c-8803-e0f5a4b6e788 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:41.093971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c62f4-f354-4031-a9df-bd7079394175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:41.094639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c62f4-f354-4031-a9df-bd7079394175 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:41.094974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c62f4-f354-4031-a9df-bd7079394175 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:41.095233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c62f4-f354-4031-a9df-bd7079394175 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:41.095957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c62f4-f354-4031-a9df-bd7079394175 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:41.097103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c62f4-f354-4031-a9df-bd7079394175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:41.098302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c62f4-f354-4031-a9df-bd7079394175 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:41.104281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 469/960] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:41.569970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8256f-22aa-4248-9c08-28fbc709e6bc None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:41.570347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8256f-22aa-4248-9c08-28fbc709e6bc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:41.570545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8256f-22aa-4248-9c08-28fbc709e6bc None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:41.572192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 492/961] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:41.579765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26ed1-371f-4144-9bc4-1674335444a9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:41.580055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26ed1-371f-4144-9bc4-1674335444a9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:41.580353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa26ed1-371f-4144-9bc4-1674335444a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:41.599037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-eaa26ed1-371f-4144-9bc4-1674335444a9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:41.600654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-eaa26ed1-371f-4144-9bc4-1674335444a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:41.673507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 470/962] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:41.699661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8256f-22aa-4248-9c08-28fbc709e6bc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:41.807109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:41.812423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8256f-22aa-4248-9c08-28fbc709e6bc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:41.849028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:41.850123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:41.850658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:41.851149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:41.852060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:41.853680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:41.898869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.sql.core [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 09:28:41.898869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 09:28:41.898869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [parameters: {'user_id': '7c350a9ac0284272b682daa4415409a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 09:28:41.898869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80512) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application conn.query(q) Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result.read() Jun 24 09:28:41.903289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 09:28:41.904167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application next(self.gen) Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application yield resource Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application next(self.gen) Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise self.value Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application session.commit() Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 09:28:41.905636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.session.flush() Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application compat.raise_( Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 09:28:41.906727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 09:28:41.908615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application conn.query(q) Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result.read() Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 09:28:41.915939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [parameters: {'user_id': '7c350a9ac0284272b682daa4415409a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:41.918102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 09:28:41.920025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 09:28:41.922670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 09:28:41.922670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 09:28:41.922670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 09:28:41.922670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 09:28:41.922670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 09:28:41.922670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:41.922670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 493/963] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 09:28:41 2022] POST /identity/v3/users => generated 160 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:41.923601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa26ed1-371f-4144-9bc4-1674335444a9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:41.981118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:42.022215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa26ed1-371f-4144-9bc4-1674335444a9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:42.058720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec87ae0-70ea-46d9-bb49-0363eb8af35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:42.060019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec87ae0-70ea-46d9-bb49-0363eb8af35f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:42.060507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec87ae0-70ea-46d9-bb49-0363eb8af35f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:42.061000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec87ae0-70ea-46d9-bb49-0363eb8af35f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:42.069322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec87ae0-70ea-46d9-bb49-0363eb8af35f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:42.071030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec87ae0-70ea-46d9-bb49-0363eb8af35f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3ec87ae0-70ea-46d9-bb49-0363eb8af35f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:42.086284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:42.087324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 09:28:42.088291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:42.090989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 471/964] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:42.096867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:42.205760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de8325-0a69-4944-a959-b95261aa299c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:42.241124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77775ed-c873-40c5-a416-b05f60000031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:42.242138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77775ed-c873-40c5-a416-b05f60000031 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:42.242642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77775ed-c873-40c5-a416-b05f60000031 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:42.243222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77775ed-c873-40c5-a416-b05f60000031 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:42.244234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77775ed-c873-40c5-a416-b05f60000031 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:42.244740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77775ed-c873-40c5-a416-b05f60000031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:42.246579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77775ed-c873-40c5-a416-b05f60000031 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:42.287502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 494/965] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 09:28:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:42.500260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a3ab-21d6-4e9b-8106-80e50427c342 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:42.500754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a3ab-21d6-4e9b-8106-80e50427c342 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:42.500754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a3ab-21d6-4e9b-8106-80e50427c342 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:42.502342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 472/966] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:42.508653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7d952-4705-42cd-aff0-84395204b1d1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:42.508954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7d952-4705-42cd-aff0-84395204b1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:42.509240 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7d952-4705-42cd-aff0-84395204b1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:42.526364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-54b7d952-4705-42cd-aff0-84395204b1d1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:42.527901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-54b7d952-4705-42cd-aff0-84395204b1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:42.542881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:42.602987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 495/967] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:42.625868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02a3ab-21d6-4e9b-8106-80e50427c342 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:42.732355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02a3ab-21d6-4e9b-8106-80e50427c342 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:42.757546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:42.768616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fbbb2-4d15-4776-be6e-84605d21c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:42.769428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fbbb2-4d15-4776-be6e-84605d21c472 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:42.770800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fbbb2-4d15-4776-be6e-84605d21c472 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:42.770800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fbbb2-4d15-4776-be6e-84605d21c472 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:42.770800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fbbb2-4d15-4776-be6e-84605d21c472 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:42.772072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6fbbb2-4d15-4776-be6e-84605d21c472 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-be6fbbb2-4d15-4776-be6e-84605d21c472 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:42.784517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:42.785509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:42.786373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 473/968] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:42.793247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7d952-4705-42cd-aff0-84395204b1d1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:42.894609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b7d952-4705-42cd-aff0-84395204b1d1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:42.929207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01936ae0-39a9-48a6-86d6-c7f00a38ec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:42.929950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01936ae0-39a9-48a6-86d6-c7f00a38ec9a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:42.930156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01936ae0-39a9-48a6-86d6-c7f00a38ec9a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:42.930437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01936ae0-39a9-48a6-86d6-c7f00a38ec9a None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:42.931178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01936ae0-39a9-48a6-86d6-c7f00a38ec9a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:42.931490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01936ae0-39a9-48a6-86d6-c7f00a38ec9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:42.932868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01936ae0-39a9-48a6-86d6-c7f00a38ec9a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:42.942363 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 496/969] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:42.943633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fbbb2-4d15-4776-be6e-84605d21c472 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:43.044805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6fbbb2-4d15-4776-be6e-84605d21c472 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:43.078493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b57d59-41c8-44f6-967b-e441979720ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:43.079260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b57d59-41c8-44f6-967b-e441979720ef None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.079548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b57d59-41c8-44f6-967b-e441979720ef None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.079829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b57d59-41c8-44f6-967b-e441979720ef None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.080534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b57d59-41c8-44f6-967b-e441979720ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:43.080872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b57d59-41c8-44f6-967b-e441979720ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:43.082246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b57d59-41c8-44f6-967b-e441979720ef None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:43.092027 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 474/970] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:43.092979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01936ae0-39a9-48a6-86d6-c7f00a38ec9a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:43.109510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:43.132500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00179f7-3a61-460f-aa5e-aa51258d55d9 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.132835 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00179f7-3a61-460f-aa5e-aa51258d55d9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.133069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00179f7-3a61-460f-aa5e-aa51258d55d9 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.134572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 475/971] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:43.139339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedff5e-e8a1-46bc-ba84-a99ef450756c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.139632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedff5e-e8a1-46bc-ba84-a99ef450756c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.139917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedff5e-e8a1-46bc-ba84-a99ef450756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.157078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bcedff5e-e8a1-46bc-ba84-a99ef450756c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:43.158272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bcedff5e-e8a1-46bc-ba84-a99ef450756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:43.196884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01936ae0-39a9-48a6-86d6-c7f00a38ec9a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:43.208358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:43.230326 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 476/972] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:43.232599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e44fbb-786c-45f6-bc5a-66f3c6dd1ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:43.233264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e44fbb-786c-45f6-bc5a-66f3c6dd1ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.233551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e44fbb-786c-45f6-bc5a-66f3c6dd1ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.233985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e44fbb-786c-45f6-bc5a-66f3c6dd1ad4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.234795 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e44fbb-786c-45f6-bc5a-66f3c6dd1ad4 None admin] RBAC: Adding query filter params (interface=admin, service_id=6e71d3c5c01745e690dc72ef4e54253d, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:43.235145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e44fbb-786c-45f6-bc5a-66f3c6dd1ad4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:43.236767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e44fbb-786c-45f6-bc5a-66f3c6dd1ad4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:43.247649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 497/973] 10.222.0.42 () {56 vars in 1249 bytes} [Fri Jun 24 09:28:43 2022] GET /identity/v3/endpoints?service_id=6e71d3c5c01745e690dc72ef4e54253d&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:43.248654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedff5e-e8a1-46bc-ba84-a99ef450756c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:43.254869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e44fbb-786c-45f6-bc5a-66f3c6dd1ad4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:43.332370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:43.350488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedff5e-e8a1-46bc-ba84-a99ef450756c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:43.353532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e44fbb-786c-45f6-bc5a-66f3c6dd1ad4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:43.384423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7952ba86-c627-4ae9-b379-8c0131484100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:43.385086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952ba86-c627-4ae9-b379-8c0131484100 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.385374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952ba86-c627-4ae9-b379-8c0131484100 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.385653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952ba86-c627-4ae9-b379-8c0131484100 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.386331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952ba86-c627-4ae9-b379-8c0131484100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:43.387742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7952ba86-c627-4ae9-b379-8c0131484100 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:43.389425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddcdc2-4678-4be6-8d36-8dcb0dd27bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:43.390232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddcdc2-4678-4be6-8d36-8dcb0dd27bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.390515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddcdc2-4678-4be6-8d36-8dcb0dd27bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.390790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddcdc2-4678-4be6-8d36-8dcb0dd27bc0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.401421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 477/974] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 09:28:43 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:28:43.401421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588563-c7d3-46ee-8b38-3fcdad9113c2 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.401421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588563-c7d3-46ee-8b38-3fcdad9113c2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.401421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77588563-c7d3-46ee-8b38-3fcdad9113c2 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.401421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 478/975] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:43.404079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217e404-f25e-4375-ac10-ba4d4ffbd767 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.404378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217e404-f25e-4375-ac10-ba4d4ffbd767 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.405034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217e404-f25e-4375-ac10-ba4d4ffbd767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.407823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddcdc2-4678-4be6-8d36-8dcb0dd27bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-45ddcdc2-4678-4be6-8d36-8dcb0dd27bc0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:43.416988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:43.418051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:43.419390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:43.420396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 498/976] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 09:28:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:43.424679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddcdc2-4678-4be6-8d36-8dcb0dd27bc0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:43.425891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2217e404-f25e-4375-ac10-ba4d4ffbd767 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:43.427147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2217e404-f25e-4375-ac10-ba4d4ffbd767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:43.477253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:43.506892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 479/977] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:43.534646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217e404-f25e-4375-ac10-ba4d4ffbd767 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:43.544641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddcdc2-4678-4be6-8d36-8dcb0dd27bc0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:43.587361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fab22-14e2-4835-8b0d-0f3ef00c150f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:43.588286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fab22-14e2-4835-8b0d-0f3ef00c150f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.588580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fab22-14e2-4835-8b0d-0f3ef00c150f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.590880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fab22-14e2-4835-8b0d-0f3ef00c150f None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.590880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fab22-14e2-4835-8b0d-0f3ef00c150f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:43.590880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fab22-14e2-4835-8b0d-0f3ef00c150f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:43.592276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fab22-14e2-4835-8b0d-0f3ef00c150f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:43.598611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:43.603794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 499/978] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 09:28:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:43.609616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fab22-14e2-4835-8b0d-0f3ef00c150f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:43.649207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217e404-f25e-4375-ac10-ba4d4ffbd767 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:43.685782 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6efbc-e4b8-4636-bb3c-3a795310b83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:43.686457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6efbc-e4b8-4636-bb3c-3a795310b83b None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.686746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6efbc-e4b8-4636-bb3c-3a795310b83b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.687063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6efbc-e4b8-4636-bb3c-3a795310b83b None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.687786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6efbc-e4b8-4636-bb3c-3a795310b83b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:43.689174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6efbc-e4b8-4636-bb3c-3a795310b83b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:43.717470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fab22-14e2-4835-8b0d-0f3ef00c150f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:43.752484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76b78-5989-4590-be00-d501e43dda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:43.753391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76b78-5989-4590-be00-d501e43dda34 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.753656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76b78-5989-4590-be00-d501e43dda34 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.753941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76b78-5989-4590-be00-d501e43dda34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.761117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 480/979] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:28:43 2022] POST /identity/v3/services => generated 242 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:28:43.765184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d76b78-5989-4590-be00-d501e43dda34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:43.766674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d76b78-5989-4590-be00-d501e43dda34 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-27d76b78-5989-4590-be00-d501e43dda34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:43.788886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:43.791630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:43.792754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:43.792754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:43.792754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:43.792754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:43.792754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 500/980] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:43.796212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6efbc-e4b8-4636-bb3c-3a795310b83b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:43.839119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:43.931750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6efbc-e4b8-4636-bb3c-3a795310b83b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:43.968659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874189f-86e7-476a-8f86-f721e32502b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:43.969492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874189f-86e7-476a-8f86-f721e32502b7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:43.969890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874189f-86e7-476a-8f86-f721e32502b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:43.970269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6874189f-86e7-476a-8f86-f721e32502b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:43.971128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874189f-86e7-476a-8f86-f721e32502b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:43.972072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874189f-86e7-476a-8f86-f721e32502b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:43.973587 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6874189f-86e7-476a-8f86-f721e32502b7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:43.986418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 481/981] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:43.992300 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76b78-5989-4590-be00-d501e43dda34 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:44.048093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:44.095652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76b78-5989-4590-be00-d501e43dda34 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:44.130965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45311fd5-c1e0-4edf-8fcb-3070bf1cafc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:44.131866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311fd5-c1e0-4edf-8fcb-3070bf1cafc6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:44.132224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311fd5-c1e0-4edf-8fcb-3070bf1cafc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:44.132572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45311fd5-c1e0-4edf-8fcb-3070bf1cafc6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:44.139858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45311fd5-c1e0-4edf-8fcb-3070bf1cafc6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:44.141366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45311fd5-c1e0-4edf-8fcb-3070bf1cafc6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-45311fd5-c1e0-4edf-8fcb-3070bf1cafc6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:44.157286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:44.158435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 09:28:44.160457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:44.161073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 501/982] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:28:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:44.166742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874189f-86e7-476a-8f86-f721e32502b7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:44.260409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:44.269613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6874189f-86e7-476a-8f86-f721e32502b7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:44.304934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb97c88-a8f1-44fe-b196-6240adaf2e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:44.305693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb97c88-a8f1-44fe-b196-6240adaf2e09 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:44.306046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb97c88-a8f1-44fe-b196-6240adaf2e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:44.306391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb97c88-a8f1-44fe-b196-6240adaf2e09 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:44.307339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb97c88-a8f1-44fe-b196-6240adaf2e09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:44.307717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb97c88-a8f1-44fe-b196-6240adaf2e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:44.309297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb97c88-a8f1-44fe-b196-6240adaf2e09 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:44.331170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 482/983] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 09:28:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:44.333647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45311fd5-c1e0-4edf-8fcb-3070bf1cafc6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:44.437673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45311fd5-c1e0-4edf-8fcb-3070bf1cafc6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:44.451562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:44.472943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796f733-badc-4b54-b2ee-cc0e54e3de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:44.473673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796f733-badc-4b54-b2ee-cc0e54e3de99 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:44.474032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796f733-badc-4b54-b2ee-cc0e54e3de99 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:44.474371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796f733-badc-4b54-b2ee-cc0e54e3de99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:44.546741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796f733-badc-4b54-b2ee-cc0e54e3de99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:44.548225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796f733-badc-4b54-b2ee-cc0e54e3de99 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:44.654197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 502/984] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:44 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:28:44.659952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb97c88-a8f1-44fe-b196-6240adaf2e09 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:44.777680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb97c88-a8f1-44fe-b196-6240adaf2e09 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:44.813508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf68d2-a8b9-4269-80f0-99954d9513ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:44.814403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf68d2-a8b9-4269-80f0-99954d9513ba None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:44.814742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf68d2-a8b9-4269-80f0-99954d9513ba None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:44.815125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf68d2-a8b9-4269-80f0-99954d9513ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:44.828158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf68d2-a8b9-4269-80f0-99954d9513ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:44.829604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf68d2-a8b9-4269-80f0-99954d9513ba None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a3cf68d2-a8b9-4269-80f0-99954d9513ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:44.849469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:44.850368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:44.855689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:44.855689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:44.855689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:44.855689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:44.855689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 483/985] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:44.857396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796f733-badc-4b54-b2ee-cc0e54e3de99 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:44.872520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:44.962064 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796f733-badc-4b54-b2ee-cc0e54e3de99 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:44.996473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff19022-d9a9-4cb9-9b16-ccf112a27ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:44.997234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19022-d9a9-4cb9-9b16-ccf112a27ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:44.997513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19022-d9a9-4cb9-9b16-ccf112a27ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:44.997788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19022-d9a9-4cb9-9b16-ccf112a27ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:44.998502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff19022-d9a9-4cb9-9b16-ccf112a27ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:44.998810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff19022-d9a9-4cb9-9b16-ccf112a27ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:45.000286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff19022-d9a9-4cb9-9b16-ccf112a27ed3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:45.013117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 503/986] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:45.017519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf68d2-a8b9-4269-80f0-99954d9513ba None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:45.021665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:45.121378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf68d2-a8b9-4269-80f0-99954d9513ba None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:45.156165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d01aa-5e1b-4acb-b22c-b1eae59bc36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:45.156963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d01aa-5e1b-4acb-b22c-b1eae59bc36d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:45.157244 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d01aa-5e1b-4acb-b22c-b1eae59bc36d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:45.157519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d01aa-5e1b-4acb-b22c-b1eae59bc36d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:45.164693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d01aa-5e1b-4acb-b22c-b1eae59bc36d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:45.166137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d01aa-5e1b-4acb-b22c-b1eae59bc36d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f95d01aa-5e1b-4acb-b22c-b1eae59bc36d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:45.180294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:45.181175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:45.182084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:45.182084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:45.182084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:45.182084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:45.182084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:45.182084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:45.182084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:45.182084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:45.182084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 484/987] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:45.188688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff19022-d9a9-4cb9-9b16-ccf112a27ed3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:45.261947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:45.292371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff19022-d9a9-4cb9-9b16-ccf112a27ed3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:45.327002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917375c-de19-47c7-9264-9ab1ff538d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:45.327670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917375c-de19-47c7-9264-9ab1ff538d79 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:45.327957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917375c-de19-47c7-9264-9ab1ff538d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:45.328238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917375c-de19-47c7-9264-9ab1ff538d79 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:45.329025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917375c-de19-47c7-9264-9ab1ff538d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:45.329343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917375c-de19-47c7-9264-9ab1ff538d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:45.330817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917375c-de19-47c7-9264-9ab1ff538d79 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:45.348347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 504/988] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:45.349516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d01aa-5e1b-4acb-b22c-b1eae59bc36d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:45.412348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:45.451853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d01aa-5e1b-4acb-b22c-b1eae59bc36d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:45.461677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c872811-9cc5-48fb-a6ec-7c1697feee8f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:45.461968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c872811-9cc5-48fb-a6ec-7c1697feee8f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:45.462245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c872811-9cc5-48fb-a6ec-7c1697feee8f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:45.463852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 505/989] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:28:45.468529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c705ee-df52-48bd-9f5e-af57ef96b304 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:45.468816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c705ee-df52-48bd-9f5e-af57ef96b304 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:45.469104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c705ee-df52-48bd-9f5e-af57ef96b304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:45.486673 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8ab72-c459-4333-b84d-bbb24292fc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:45.486887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e5c705ee-df52-48bd-9f5e-af57ef96b304 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:45.487984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8ab72-c459-4333-b84d-bbb24292fc84 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:45.488268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8ab72-c459-4333-b84d-bbb24292fc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:45.488545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8ab72-c459-4333-b84d-bbb24292fc84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:45.488724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e5c705ee-df52-48bd-9f5e-af57ef96b304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:45.489374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8ab72-c459-4333-b84d-bbb24292fc84 None admin] RBAC: Adding query filter params (role.id=4e20c7e459304902a6face48dac75f06, scope.project.id=0ec77816151b45228e087023588839da, user.id=2a5fd14de7794b14bd0a2a2a62a70762) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:45.489686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8ab72-c459-4333-b84d-bbb24292fc84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:45.491140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8ab72-c459-4333-b84d-bbb24292fc84 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:45.497264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 485/990] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:45 2022] GET /identity/v3/role_assignments?user.id=2a5fd14de7794b14bd0a2a2a62a70762&scope.project.id=0ec77816151b45228e087023588839da&role.id=4e20c7e459304902a6face48dac75f06 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:45.563971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 506/991] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:45.588279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8ab72-c459-4333-b84d-bbb24292fc84 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:45.702193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8ab72-c459-4333-b84d-bbb24292fc84 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:45.728915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:45.738590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37926e-5df0-4ecf-b180-54c78882fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:45.739447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37926e-5df0-4ecf-b180-54c78882fe4f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:45.739731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37926e-5df0-4ecf-b180-54c78882fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:45.740007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37926e-5df0-4ecf-b180-54c78882fe4f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:45.740660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37926e-5df0-4ecf-b180-54c78882fe4f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:45.742031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37926e-5df0-4ecf-b180-54c78882fe4f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-8b37926e-5df0-4ecf-b180-54c78882fe4f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:45.754535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:45.755712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:45.756556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 486/992] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 09:28:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:45.761880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c705ee-df52-48bd-9f5e-af57ef96b304 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:45.834865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:45.875620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c705ee-df52-48bd-9f5e-af57ef96b304 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:45.882228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e9dcc-6b38-487d-925e-4bf617ce8f19 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:45.882508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e9dcc-6b38-487d-925e-4bf617ce8f19 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:45.882787 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e9dcc-6b38-487d-925e-4bf617ce8f19 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:45.884310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 487/993] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:45.889269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c957a10-ba47-4e9c-be1c-a11bf7f42302 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:45.889560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c957a10-ba47-4e9c-be1c-a11bf7f42302 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:45.889839 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c957a10-ba47-4e9c-be1c-a11bf7f42302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:45.907391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8c957a10-ba47-4e9c-be1c-a11bf7f42302 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:45.908761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8c957a10-ba47-4e9c-be1c-a11bf7f42302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:45.914482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106b927-e5f9-45ad-b874-c5bedeefd3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:45.915175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106b927-e5f9-45ad-b874-c5bedeefd3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:45.915463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106b927-e5f9-45ad-b874-c5bedeefd3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:45.915738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106b927-e5f9-45ad-b874-c5bedeefd3c1 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:45.916440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106b927-e5f9-45ad-b874-c5bedeefd3c1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:45.916736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106b927-e5f9-45ad-b874-c5bedeefd3c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:45.918097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106b927-e5f9-45ad-b874-c5bedeefd3c1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:45.922898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 507/994] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:45.929565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106b927-e5f9-45ad-b874-c5bedeefd3c1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:45.984780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 488/995] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:46.008812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c957a10-ba47-4e9c-be1c-a11bf7f42302 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:46.040836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106b927-e5f9-45ad-b874-c5bedeefd3c1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:46.070424 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:46.079493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11726c17-ab9a-45f1-87ae-c95363a03384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:46.085573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11726c17-ab9a-45f1-87ae-c95363a03384 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:46.085573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11726c17-ab9a-45f1-87ae-c95363a03384 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:46.085573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11726c17-ab9a-45f1-87ae-c95363a03384 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:46.085573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11726c17-ab9a-45f1-87ae-c95363a03384 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:46.085573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11726c17-ab9a-45f1-87ae-c95363a03384 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:46.085573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11726c17-ab9a-45f1-87ae-c95363a03384 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:46.093098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 508/996] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 09:28:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:46.093908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11726c17-ab9a-45f1-87ae-c95363a03384 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:46.122751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c957a10-ba47-4e9c-be1c-a11bf7f42302 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:46.147048 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:46.161407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637f3bc-3e52-4d12-95ea-91d8ecf927dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:46.162206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637f3bc-3e52-4d12-95ea-91d8ecf927dd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:46.162491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637f3bc-3e52-4d12-95ea-91d8ecf927dd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:46.162765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637f3bc-3e52-4d12-95ea-91d8ecf927dd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:46.163445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637f3bc-3e52-4d12-95ea-91d8ecf927dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:46.164820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637f3bc-3e52-4d12-95ea-91d8ecf927dd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a637f3bc-3e52-4d12-95ea-91d8ecf927dd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:46.176706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:46.178019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:46.178976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 489/997] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:46.185629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637f3bc-3e52-4d12-95ea-91d8ecf927dd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:46.210284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11726c17-ab9a-45f1-87ae-c95363a03384 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:46.248899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b677-7236-4959-adfb-f18b7d18a37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:46.249472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b677-7236-4959-adfb-f18b7d18a37b None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:46.249753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b677-7236-4959-adfb-f18b7d18a37b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:46.250032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b677-7236-4959-adfb-f18b7d18a37b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:46.250768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21b677-7236-4959-adfb-f18b7d18a37b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:46.252173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21b677-7236-4959-adfb-f18b7d18a37b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:46.288689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637f3bc-3e52-4d12-95ea-91d8ecf927dd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:46.323247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7bd5b-e27e-4039-b6a3-d312cf6c8a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:46.330917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7bd5b-e27e-4039-b6a3-d312cf6c8a15 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:46.331831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 509/998] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 09:28:46 2022] POST /identity/v3/endpoints => generated 325 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:28:46.331951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7bd5b-e27e-4039-b6a3-d312cf6c8a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:46.331951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7bd5b-e27e-4039-b6a3-d312cf6c8a15 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:46.331951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7bd5b-e27e-4039-b6a3-d312cf6c8a15 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:46.331951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7bd5b-e27e-4039-b6a3-d312cf6c8a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:46.331951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7bd5b-e27e-4039-b6a3-d312cf6c8a15 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:46.336140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 490/999] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:46.341844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b677-7236-4959-adfb-f18b7d18a37b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:46.401299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:46.463380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b677-7236-4959-adfb-f18b7d18a37b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:46.502504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e3a4-7582-497e-83e9-1b0692b371de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:46.504170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e3a4-7582-497e-83e9-1b0692b371de None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:46.504455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e3a4-7582-497e-83e9-1b0692b371de None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:46.504731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64e3a4-7582-497e-83e9-1b0692b371de None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:46.505434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64e3a4-7582-497e-83e9-1b0692b371de None admin] RBAC: Adding query filter params (type=compute) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:46.505740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64e3a4-7582-497e-83e9-1b0692b371de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:46.507134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b64e3a4-7582-497e-83e9-1b0692b371de None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:46.512552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 510/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:46.519295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7bd5b-e27e-4039-b6a3-d312cf6c8a15 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:46.569624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:46.632243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7bd5b-e27e-4039-b6a3-d312cf6c8a15 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:46.669386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7b27e-5f64-4575-bdb5-15d7e49b6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:46.670110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b27e-5f64-4575-bdb5-15d7e49b6f08 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:46.670395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b27e-5f64-4575-bdb5-15d7e49b6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:46.670670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b27e-5f64-4575-bdb5-15d7e49b6f08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:46.671545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7b27e-5f64-4575-bdb5-15d7e49b6f08 None admin] RBAC: Adding query filter params (interface=public, service_id=87e95affffef44f9b3b94ea7e5f4a82b, region_id=RegionOne) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:46.671865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7b27e-5f64-4575-bdb5-15d7e49b6f08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:46.673241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7b27e-5f64-4575-bdb5-15d7e49b6f08 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:46.682883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 491/1001] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 09:28:46 2022] GET /identity/v3/endpoints?service_id=87e95affffef44f9b3b94ea7e5f4a82b&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:46.684363 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e3a4-7582-497e-83e9-1b0692b371de None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:46.788624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64e3a4-7582-497e-83e9-1b0692b371de None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:46.799411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:46.823519 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e03c68-a6f3-4c05-a3dd-9db4be5d4f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:46.824218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e03c68-a6f3-4c05-a3dd-9db4be5d4f84 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:46.824509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e03c68-a6f3-4c05-a3dd-9db4be5d4f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:46.824787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e03c68-a6f3-4c05-a3dd-9db4be5d4f84 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:46.825476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e03c68-a6f3-4c05-a3dd-9db4be5d4f84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:46.826862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e03c68-a6f3-4c05-a3dd-9db4be5d4f84 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:46.842914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 511/1002] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 09:28:46 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:28:47.581844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0b676-8aa5-4113-9dc1-98b1eb2f1c2a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:47.582375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0b676-8aa5-4113-9dc1-98b1eb2f1c2a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:47.582375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0b676-8aa5-4113-9dc1-98b1eb2f1c2a None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:47.584113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 492/1003] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:47.591288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3f1f8-aca4-4006-a999-415374ae9b85 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:47.591288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3f1f8-aca4-4006-a999-415374ae9b85 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:47.591288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3f1f8-aca4-4006-a999-415374ae9b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:47.607101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a8b3f1f8-aca4-4006-a999-415374ae9b85 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:47.608356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a8b3f1f8-aca4-4006-a999-415374ae9b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:47.676689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 512/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:47 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:47.698664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0b676-8aa5-4113-9dc1-98b1eb2f1c2a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:47.801103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0b676-8aa5-4113-9dc1-98b1eb2f1c2a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:47.813746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:47.836409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124900a-a731-4391-b89e-5265b1deff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:47.837141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124900a-a731-4391-b89e-5265b1deff75 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:47.837428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124900a-a731-4391-b89e-5265b1deff75 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:47.837705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124900a-a731-4391-b89e-5265b1deff75 None admin] PATH_INFO: `/v3/services/image` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:47.838357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124900a-a731-4391-b89e-5265b1deff75 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:47.839766 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124900a-a731-4391-b89e-5265b1deff75 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c124900a-a731-4391-b89e-5265b1deff75 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:47.852317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:47.853360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 09:28:47.854226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:47.855782 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 493/1005] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Jun 24 09:28:47 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:47.859359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3f1f8-aca4-4006-a999-415374ae9b85 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:47.960956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3f1f8-aca4-4006-a999-415374ae9b85 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:47.963316 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:47.995648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2373bbc-35bb-4328-94cb-e657ec21e624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:47.996541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373bbc-35bb-4328-94cb-e657ec21e624 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:47.996840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373bbc-35bb-4328-94cb-e657ec21e624 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:47.997289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373bbc-35bb-4328-94cb-e657ec21e624 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:47.998047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2373bbc-35bb-4328-94cb-e657ec21e624 None admin] RBAC: Adding query filter params (name=image) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:47.998637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2373bbc-35bb-4328-94cb-e657ec21e624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:48.000051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2373bbc-35bb-4328-94cb-e657ec21e624 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:48.009662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 513/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:48.010770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124900a-a731-4391-b89e-5265b1deff75 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:48.119774 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124900a-a731-4391-b89e-5265b1deff75 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:48.153361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e11a19-c2db-45d6-b2ec-3aecdc6dbedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:48.154035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e11a19-c2db-45d6-b2ec-3aecdc6dbedd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:48.154309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e11a19-c2db-45d6-b2ec-3aecdc6dbedd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:48.154586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e11a19-c2db-45d6-b2ec-3aecdc6dbedd None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:48.155319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e11a19-c2db-45d6-b2ec-3aecdc6dbedd None admin] RBAC: Adding query filter params (type=image) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:48.155627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e11a19-c2db-45d6-b2ec-3aecdc6dbedd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:48.156992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e11a19-c2db-45d6-b2ec-3aecdc6dbedd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:48.162284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 494/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:48.448786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa19d-c2ab-4369-80c7-3c1532c6ba03 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:48.449145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa19d-c2ab-4369-80c7-3c1532c6ba03 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:48.449249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844aa19d-c2ab-4369-80c7-3c1532c6ba03 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:48.450771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 514/1008] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:48.456109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add06d-5b71-4a40-87d4-cdb54b3d1844 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:48.456875 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add06d-5b71-4a40-87d4-cdb54b3d1844 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:48.457158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6add06d-5b71-4a40-87d4-cdb54b3d1844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:48.474904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d6add06d-5b71-4a40-87d4-cdb54b3d1844 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:48.476088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d6add06d-5b71-4a40-87d4-cdb54b3d1844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:48.512305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:48.546657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 495/1009] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:48.571816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aa19d-c2ab-4369-80c7-3c1532c6ba03 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:48.685804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844aa19d-c2ab-4369-80c7-3c1532c6ba03 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:48.722292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68830d-30ca-4598-bff9-a858a5c3bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:48.722292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68830d-30ca-4598-bff9-a858a5c3bb5a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:48.722292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68830d-30ca-4598-bff9-a858a5c3bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:48.722292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68830d-30ca-4598-bff9-a858a5c3bb5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:48.723545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68830d-30ca-4598-bff9-a858a5c3bb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:48.725033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68830d-30ca-4598-bff9-a858a5c3bb5a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:48.726904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 515/1010] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:48.732686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6add06d-5b71-4a40-87d4-cdb54b3d1844 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:48.835190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6add06d-5b71-4a40-87d4-cdb54b3d1844 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:48.870394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1255d3-90bc-4de0-8724-8fe99392dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:48.870631 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bba05b-7db5-430e-806d-a5658f28b853 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:48.870912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bba05b-7db5-430e-806d-a5658f28b853 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:48.871093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1255d3-90bc-4de0-8724-8fe99392dae0 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:48.871189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bba05b-7db5-430e-806d-a5658f28b853 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:48.871363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1255d3-90bc-4de0-8724-8fe99392dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:48.871643 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1255d3-90bc-4de0-8724-8fe99392dae0 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:48.872363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1255d3-90bc-4de0-8724-8fe99392dae0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:48.872752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 516/1011] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:48.873796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1255d3-90bc-4de0-8724-8fe99392dae0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:48.880584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec79f2-88ca-4170-9b69-b90530533f1b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:48.880950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec79f2-88ca-4170-9b69-b90530533f1b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:48.881307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec79f2-88ca-4170-9b69-b90530533f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:48.897813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-dcec79f2-88ca-4170-9b69-b90530533f1b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:48.904135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-dcec79f2-88ca-4170-9b69-b90530533f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:48.928892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:48.952766 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 496/1012] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:28:48 2022] POST /identity/v3/projects => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:48.967622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 517/1013] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:48 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:48.993201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1255d3-90bc-4de0-8724-8fe99392dae0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:49.022113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:49.106315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1255d3-90bc-4de0-8724-8fe99392dae0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:49.145783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b256a08-6783-41bd-9753-adb6a007910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:49.146584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b256a08-6783-41bd-9753-adb6a007910a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:49.146902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b256a08-6783-41bd-9753-adb6a007910a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:49.147186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b256a08-6783-41bd-9753-adb6a007910a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:49.147843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b256a08-6783-41bd-9753-adb6a007910a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:49.149283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b256a08-6783-41bd-9753-adb6a007910a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-4b256a08-6783-41bd-9753-adb6a007910a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:49.161725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:49.162723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:49.163628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 497/1014] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:49.169056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec79f2-88ca-4170-9b69-b90530533f1b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:49.275382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec79f2-88ca-4170-9b69-b90530533f1b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:49.310157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddecd4-e568-4474-a6af-91ad58c909e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:49.310821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddecd4-e568-4474-a6af-91ad58c909e4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:49.311153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddecd4-e568-4474-a6af-91ad58c909e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:49.311433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddecd4-e568-4474-a6af-91ad58c909e4 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:49.312141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddecd4-e568-4474-a6af-91ad58c909e4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:49.312446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddecd4-e568-4474-a6af-91ad58c909e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:49.313800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddecd4-e568-4474-a6af-91ad58c909e4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:49.323437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 518/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:49.324619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b256a08-6783-41bd-9753-adb6a007910a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:49.412648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:49.427848 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b256a08-6783-41bd-9753-adb6a007910a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:49.461741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4d3c4-4379-4918-ad7c-ac255f2bb221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:49.462405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4d3c4-4379-4918-ad7c-ac255f2bb221 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:49.462690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4d3c4-4379-4918-ad7c-ac255f2bb221 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:49.463002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4d3c4-4379-4918-ad7c-ac255f2bb221 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:49.463710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4d3c4-4379-4918-ad7c-ac255f2bb221 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:49.464022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4d3c4-4379-4918-ad7c-ac255f2bb221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:49.466289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4d3c4-4379-4918-ad7c-ac255f2bb221 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:49.470577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 498/1016] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 09:28:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:49.476848 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddecd4-e568-4474-a6af-91ad58c909e4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:49.506780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:49.577632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddecd4-e568-4474-a6af-91ad58c909e4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:49.616760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effa672-5595-4e04-9043-a18931808c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:49.617426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa672-5595-4e04-9043-a18931808c10 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:49.617709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa672-5595-4e04-9043-a18931808c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:49.617981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effa672-5595-4e04-9043-a18931808c10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:49.618730 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effa672-5595-4e04-9043-a18931808c10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:49.620124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4effa672-5595-4e04-9043-a18931808c10 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:49.677785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 519/1017] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 09:28:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:50.219340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f1318-8176-4448-9886-82160e9b038b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:50.219864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f1318-8176-4448-9886-82160e9b038b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:50.219864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f1318-8176-4448-9886-82160e9b038b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:50.221280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 499/1018] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:50.226981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19304c4-f3f0-499a-a306-3edc73c8fb2a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:50.227558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19304c4-f3f0-499a-a306-3edc73c8fb2a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:50.227664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19304c4-f3f0-499a-a306-3edc73c8fb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:50.245481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b19304c4-f3f0-499a-a306-3edc73c8fb2a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:50.246656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b19304c4-f3f0-499a-a306-3edc73c8fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:50.321966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 520/1019] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:50 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:50.344620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f1318-8176-4448-9886-82160e9b038b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:50.450492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f1318-8176-4448-9886-82160e9b038b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:50.489117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad81cc6-fc86-4c15-802f-9f24a788d3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:50.489709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad81cc6-fc86-4c15-802f-9f24a788d3e7 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:50.489996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad81cc6-fc86-4c15-802f-9f24a788d3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:50.490275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad81cc6-fc86-4c15-802f-9f24a788d3e7 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:50.491033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad81cc6-fc86-4c15-802f-9f24a788d3e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:50.492419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad81cc6-fc86-4c15-802f-9f24a788d3e7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:50.610994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 500/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:28:50 2022] POST /identity/v3/services => generated 242 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:28:51.067414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b58f-725c-42a8-bbfd-298848898017 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:51.067797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b58f-725c-42a8-bbfd-298848898017 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:51.067996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9b58f-725c-42a8-bbfd-298848898017 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:51.069417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 521/1021] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:51.074568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d16672-eff7-4d73-893e-626203605364 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:51.074897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d16672-eff7-4d73-893e-626203605364 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:51.075188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d16672-eff7-4d73-893e-626203605364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:51.092552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-98d16672-eff7-4d73-893e-626203605364 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:51.093739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-98d16672-eff7-4d73-893e-626203605364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:51.097691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:51.169316 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 501/1022] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:51.195229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9b58f-725c-42a8-bbfd-298848898017 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:51.210027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:51.298269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9b58f-725c-42a8-bbfd-298848898017 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:51.332816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c184c0-78bd-4b38-97e1-e2d56a9b168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:51.333545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c184c0-78bd-4b38-97e1-e2d56a9b168f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:51.333817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c184c0-78bd-4b38-97e1-e2d56a9b168f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:51.334097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c184c0-78bd-4b38-97e1-e2d56a9b168f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:51.335308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c184c0-78bd-4b38-97e1-e2d56a9b168f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:51.336751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c184c0-78bd-4b38-97e1-e2d56a9b168f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:51.342952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 522/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:51.344449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d16672-eff7-4d73-893e-626203605364 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:51.447950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d16672-eff7-4d73-893e-626203605364 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:51.485617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b7a30-bb21-4145-b154-9be9e0f0bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:51.486552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b7a30-bb21-4145-b154-9be9e0f0bd05 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:51.486834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b7a30-bb21-4145-b154-9be9e0f0bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:51.487664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b7a30-bb21-4145-b154-9be9e0f0bd05 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:51.488400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b7a30-bb21-4145-b154-9be9e0f0bd05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:51.489842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b7a30-bb21-4145-b154-9be9e0f0bd05 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:51.497595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:51.586964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 502/1024] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:28:51 2022] POST /identity/v3/users => generated 285 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:51.820286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6d4f-db6d-4639-bc3c-f3757e9d8382 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:51.820847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6d4f-db6d-4639-bc3c-f3757e9d8382 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:51.821131 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e6d4f-db6d-4639-bc3c-f3757e9d8382 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:51.822688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 523/1025] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:51.828168 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be110b-51a7-4dd4-81a3-5c7572a166d8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:51.828462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be110b-51a7-4dd4-81a3-5c7572a166d8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:51.828746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be110b-51a7-4dd4-81a3-5c7572a166d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:51.846939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-84be110b-51a7-4dd4-81a3-5c7572a166d8 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:51.848726 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-84be110b-51a7-4dd4-81a3-5c7572a166d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:51.926606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 503/1026] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:51.950149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e6d4f-db6d-4639-bc3c-f3757e9d8382 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:52.036202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:52.056212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e6d4f-db6d-4639-bc3c-f3757e9d8382 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:52.090115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d2830-5896-48c8-b3a7-9a2f3ca7b7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:52.090963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d2830-5896-48c8-b3a7-9a2f3ca7b7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:52.091253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d2830-5896-48c8-b3a7-9a2f3ca7b7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:52.091532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d2830-5896-48c8-b3a7-9a2f3ca7b7d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:52.102669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d2830-5896-48c8-b3a7-9a2f3ca7b7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-072d2830-5896-48c8-b3a7-9a2f3ca7b7d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:52.111414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:52.112966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:52.113833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 524/1027] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 09:28:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:52.120548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be110b-51a7-4dd4-81a3-5c7572a166d8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:52.228864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be110b-51a7-4dd4-81a3-5c7572a166d8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:52.253035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:52.264809 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae17a98-008a-4710-9aea-2bc71eb9cb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:52.265479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae17a98-008a-4710-9aea-2bc71eb9cb26 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:52.269391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae17a98-008a-4710-9aea-2bc71eb9cb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:52.269391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae17a98-008a-4710-9aea-2bc71eb9cb26 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:52.269391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae17a98-008a-4710-9aea-2bc71eb9cb26 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:52.269391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae17a98-008a-4710-9aea-2bc71eb9cb26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:52.269391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae17a98-008a-4710-9aea-2bc71eb9cb26 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:52.277855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 504/1028] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 09:28:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:52.283354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d2830-5896-48c8-b3a7-9a2f3ca7b7d0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:52.389167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d2830-5896-48c8-b3a7-9a2f3ca7b7d0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:52.422456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07df1-2ccd-4d64-84f2-eee8817f5cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:52.423283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07df1-2ccd-4d64-84f2-eee8817f5cbf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:52.423576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07df1-2ccd-4d64-84f2-eee8817f5cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:52.423854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07df1-2ccd-4d64-84f2-eee8817f5cbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:52.433225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:52.435960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07df1-2ccd-4d64-84f2-eee8817f5cbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:52.437423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07df1-2ccd-4d64-84f2-eee8817f5cbf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-6ad07df1-2ccd-4d64-84f2-eee8817f5cbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:52.454967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:52.456020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:52.456965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:52.456965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:52.456965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:52.456965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:52.456965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 525/1029] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:52.463259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae17a98-008a-4710-9aea-2bc71eb9cb26 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:52.566003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae17a98-008a-4710-9aea-2bc71eb9cb26 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:52.606895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97a80c-54fe-434d-affa-deeef7685c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:52.607567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97a80c-54fe-434d-affa-deeef7685c6e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:52.607853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97a80c-54fe-434d-affa-deeef7685c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:52.608138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97a80c-54fe-434d-affa-deeef7685c6e None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:52.608857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97a80c-54fe-434d-affa-deeef7685c6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:52.609166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97a80c-54fe-434d-affa-deeef7685c6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:52.610607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97a80c-54fe-434d-affa-deeef7685c6e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:52.627470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 505/1030] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:52.629182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07df1-2ccd-4d64-84f2-eee8817f5cbf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:52.682527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5375b0d-a8cb-4a88-9993-62b7d8438656 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:52.682823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5375b0d-a8cb-4a88-9993-62b7d8438656 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:52.683055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5375b0d-a8cb-4a88-9993-62b7d8438656 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:52.684417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 506/1031] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:52.689407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11244-e236-4e2e-9c1c-2776d2658041 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:52.689698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11244-e236-4e2e-9c1c-2776d2658041 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:52.689982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e11244-e236-4e2e-9c1c-2776d2658041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:52.708968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-18e11244-e236-4e2e-9c1c-2776d2658041 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:52.710152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-18e11244-e236-4e2e-9c1c-2776d2658041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:52.733502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07df1-2ccd-4d64-84f2-eee8817f5cbf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:52.752161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:52.770355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa7b98-c5b6-44c6-858d-893d64d6f7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:52.771267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7b98-c5b6-44c6-858d-893d64d6f7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:52.775743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7b98-c5b6-44c6-858d-893d64d6f7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:52.775743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa7b98-c5b6-44c6-858d-893d64d6f7a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:52.780860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa7b98-c5b6-44c6-858d-893d64d6f7a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:52.782417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa7b98-c5b6-44c6-858d-893d64d6f7a6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:52.783460 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 507/1032] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-74aa7b98-c5b6-44c6-858d-893d64d6f7a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:52.797805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:52.799125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:52.800297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:52.803169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 526/1033] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 09:28:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:52.805320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11244-e236-4e2e-9c1c-2776d2658041 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:52.807422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa7b98-c5b6-44c6-858d-893d64d6f7a6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:52.863759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:52.912667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa7b98-c5b6-44c6-858d-893d64d6f7a6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:52.917226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e11244-e236-4e2e-9c1c-2776d2658041 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:52.949025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2d05-9b88-44ee-9d45-d2b344b7a9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:52.949739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2d05-9b88-44ee-9d45-d2b344b7a9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:52.950023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2d05-9b88-44ee-9d45-d2b344b7a9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:52.950305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2d05-9b88-44ee-9d45-d2b344b7a9f4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:52.950968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af2d05-9b88-44ee-9d45-d2b344b7a9f4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:52.952328 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af2d05-9b88-44ee-9d45-d2b344b7a9f4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:52.952430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401f28a-e85a-431d-992d-cbd7df22499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:52.952999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401f28a-e85a-431d-992d-cbd7df22499a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:52.953283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401f28a-e85a-431d-992d-cbd7df22499a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:52.953558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401f28a-e85a-431d-992d-cbd7df22499a None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:52.954392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401f28a-e85a-431d-992d-cbd7df22499a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:52.954704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401f28a-e85a-431d-992d-cbd7df22499a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:52.956723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f401f28a-e85a-431d-992d-cbd7df22499a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-12af2d05-9b88-44ee-9d45-d2b344b7a9f4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:52.965248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:52.966245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:52.967313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 527/1034] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Jun 24 09:28:52 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:52.972967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2d05-9b88-44ee-9d45-d2b344b7a9f4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:52.979482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 508/1035] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 09:28:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:52.984642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401f28a-e85a-431d-992d-cbd7df22499a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:53.017556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:53.085649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2d05-9b88-44ee-9d45-d2b344b7a9f4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:53.093413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401f28a-e85a-431d-992d-cbd7df22499a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:53.102208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:53.122475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55680537-3b6e-4f60-993b-22b7024ee39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:53.123176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55680537-3b6e-4f60-993b-22b7024ee39a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.123466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55680537-3b6e-4f60-993b-22b7024ee39a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.123748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55680537-3b6e-4f60-993b-22b7024ee39a None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.124464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55680537-3b6e-4f60-993b-22b7024ee39a None admin] RBAC: Adding query filter params (name=image) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:53.124897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55680537-3b6e-4f60-993b-22b7024ee39a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:53.126314 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55680537-3b6e-4f60-993b-22b7024ee39a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:53.132253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 528/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:53.133554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820d41-9119-4a1e-8771-49faed1b999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:53.134207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820d41-9119-4a1e-8771-49faed1b999f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.134492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820d41-9119-4a1e-8771-49faed1b999f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.134767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0820d41-9119-4a1e-8771-49faed1b999f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.137668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55680537-3b6e-4f60-993b-22b7024ee39a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:53.204547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0820d41-9119-4a1e-8771-49faed1b999f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:53.206557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0820d41-9119-4a1e-8771-49faed1b999f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:53.239157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:53.246118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55680537-3b6e-4f60-993b-22b7024ee39a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:53.281488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe519-93f4-4d9c-8884-32234607df1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:53.282156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe519-93f4-4d9c-8884-32234607df1c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.282442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe519-93f4-4d9c-8884-32234607df1c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.282717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffe519-93f4-4d9c-8884-32234607df1c None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.283453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffe519-93f4-4d9c-8884-32234607df1c None admin] RBAC: Adding query filter params (type=image) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:53.283757 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffe519-93f4-4d9c-8884-32234607df1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:53.285771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffe519-93f4-4d9c-8884-32234607df1c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:53.290968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 529/1037] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:53.296534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe519-93f4-4d9c-8884-32234607df1c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:53.314413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 509/1038] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 09:28:53.315508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820d41-9119-4a1e-8771-49faed1b999f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:53.350192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:53.411774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffe519-93f4-4d9c-8884-32234607df1c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:53.428179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0820d41-9119-4a1e-8771-49faed1b999f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:53.445940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f242e29-e6b0-4d84-b8aa-2c4622a4e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:53.446596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f242e29-e6b0-4d84-b8aa-2c4622a4e278 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.446905 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f242e29-e6b0-4d84-b8aa-2c4622a4e278 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.447186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f242e29-e6b0-4d84-b8aa-2c4622a4e278 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.447975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f242e29-e6b0-4d84-b8aa-2c4622a4e278 None admin] RBAC: Adding query filter params (interface=public, service_id=a0b5b926876f4c21816da922c510275a, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:53.448296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f242e29-e6b0-4d84-b8aa-2c4622a4e278 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:53.449654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f242e29-e6b0-4d84-b8aa-2c4622a4e278 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:53.455138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 530/1039] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 09:28:53 2022] GET /identity/v3/endpoints?service_id=a0b5b926876f4c21816da922c510275a&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:53.460146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:53.461296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f242e29-e6b0-4d84-b8aa-2c4622a4e278 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:53.465496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326293b-6e54-44c0-9ac0-a52116d50f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:53.466813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326293b-6e54-44c0-9ac0-a52116d50f9d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.467278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326293b-6e54-44c0-9ac0-a52116d50f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.467724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326293b-6e54-44c0-9ac0-a52116d50f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.479592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326293b-6e54-44c0-9ac0-a52116d50f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:53.481362 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326293b-6e54-44c0-9ac0-a52116d50f9d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e326293b-6e54-44c0-9ac0-a52116d50f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:53.504241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:53.505283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:53.506211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:53.506211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:53.506211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:53.506211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:53.508252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 510/1040] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:53.513424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326293b-6e54-44c0-9ac0-a52116d50f9d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:53.578175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f242e29-e6b0-4d84-b8aa-2c4622a4e278 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:53.588488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:53.618079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf5e9-ccae-4c9a-a947-4675230524c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:53.618750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf5e9-ccae-4c9a-a947-4675230524c6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.619071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf5e9-ccae-4c9a-a947-4675230524c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.619359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdf5e9-ccae-4c9a-a947-4675230524c6 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.620050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdf5e9-ccae-4c9a-a947-4675230524c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:53.621416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdf5e9-ccae-4c9a-a947-4675230524c6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:53.628217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 531/1041] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 09:28:53 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:28:53.628885 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326293b-6e54-44c0-9ac0-a52116d50f9d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:53.668085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46714f8a-0ddf-45be-ad22-61457e26f319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:53.668766 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46714f8a-0ddf-45be-ad22-61457e26f319 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.669054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46714f8a-0ddf-45be-ad22-61457e26f319 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.669337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46714f8a-0ddf-45be-ad22-61457e26f319 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.670075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46714f8a-0ddf-45be-ad22-61457e26f319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:53.670390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46714f8a-0ddf-45be-ad22-61457e26f319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:53.671825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46714f8a-0ddf-45be-ad22-61457e26f319 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:53.691108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 511/1042] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:53.693001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf5e9-ccae-4c9a-a947-4675230524c6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:53.742834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34ccc2-b6c7-48f7-8822-74ada566462d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.743076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34ccc2-b6c7-48f7-8822-74ada566462d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.743329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34ccc2-b6c7-48f7-8822-74ada566462d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.744862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 512/1043] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:28:53.750276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d12eb-1e07-43b6-b9eb-991e5d6fc53a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.750567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d12eb-1e07-43b6-b9eb-991e5d6fc53a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.750872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d12eb-1e07-43b6-b9eb-991e5d6fc53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.769749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2e8d12eb-1e07-43b6-b9eb-991e5d6fc53a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:53.771028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2e8d12eb-1e07-43b6-b9eb-991e5d6fc53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:53.813431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdf5e9-ccae-4c9a-a947-4675230524c6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:53.819868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:53.849372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 513/1044] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:53.852670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482b4d9-bb19-44eb-b3fc-8521ebd9eef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:53.853464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482b4d9-bb19-44eb-b3fc-8521ebd9eef4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:53.853797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482b4d9-bb19-44eb-b3fc-8521ebd9eef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:53.854076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482b4d9-bb19-44eb-b3fc-8521ebd9eef4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:53.861235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482b4d9-bb19-44eb-b3fc-8521ebd9eef4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:53.863266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482b4d9-bb19-44eb-b3fc-8521ebd9eef4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:53.873571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d12eb-1e07-43b6-b9eb-991e5d6fc53a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-4482b4d9-bb19-44eb-b3fc-8521ebd9eef4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:53.877447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:53.879302 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:53.880184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:53.880184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:53.880184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:53.880184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:53.880184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:53.880184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:53.880184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:53.880184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:53.880184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 532/1045] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:53.885874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482b4d9-bb19-44eb-b3fc-8521ebd9eef4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:53.920562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:53.981029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d12eb-1e07-43b6-b9eb-991e5d6fc53a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:53.995442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482b4d9-bb19-44eb-b3fc-8521ebd9eef4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:54.019069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8508a-216c-4214-898d-d2c4457bf2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:54.019869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8508a-216c-4214-898d-d2c4457bf2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:54.020154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8508a-216c-4214-898d-d2c4457bf2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:54.020430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8508a-216c-4214-898d-d2c4457bf2b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:54.031426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8508a-216c-4214-898d-d2c4457bf2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:54.032222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fed5e-72ab-4da8-8db2-b883700a00ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:54.032884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fed5e-72ab-4da8-8db2-b883700a00ac None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:54.033170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fed5e-72ab-4da8-8db2-b883700a00ac None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:54.033448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fed5e-72ab-4da8-8db2-b883700a00ac None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:54.034267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fed5e-72ab-4da8-8db2-b883700a00ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:54.034658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fed5e-72ab-4da8-8db2-b883700a00ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:54.036133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fed5e-72ab-4da8-8db2-b883700a00ac None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-7ff8508a-216c-4214-898d-d2c4457bf2b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:54.040991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:54.041940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:54.042807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:54.044718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 514/1046] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:54.050721 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8508a-216c-4214-898d-d2c4457bf2b9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:54.053513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 533/1047] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:54.057153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fed5e-72ab-4da8-8db2-b883700a00ac None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:54.092576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:54.153043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:54.162580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fed5e-72ab-4da8-8db2-b883700a00ac None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:54.165643 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8508a-216c-4214-898d-d2c4457bf2b9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:54.198997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffba6-f5de-4fd4-8893-a8aec9d92233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:54.199655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffba6-f5de-4fd4-8893-a8aec9d92233 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:54.199942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffba6-f5de-4fd4-8893-a8aec9d92233 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:54.200219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffba6-f5de-4fd4-8893-a8aec9d92233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:54.201056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffba6-f5de-4fd4-8893-a8aec9d92233 None admin] RBAC: Adding query filter params (role.id=4e20c7e459304902a6face48dac75f06, scope.project.id=0ec77816151b45228e087023588839da, user.id=0422e6863c7147b79ea4d194e6e07154) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:54.201370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffba6-f5de-4fd4-8893-a8aec9d92233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:54.202786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffba6-f5de-4fd4-8893-a8aec9d92233 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:54.204046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd92a8b-db48-4149-b6ac-e46ef6de6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:54.205020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd92a8b-db48-4149-b6ac-e46ef6de6c24 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:54.205636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd92a8b-db48-4149-b6ac-e46ef6de6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:54.205970 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd92a8b-db48-4149-b6ac-e46ef6de6c24 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:54.206958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd92a8b-db48-4149-b6ac-e46ef6de6c24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:54.207275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd92a8b-db48-4149-b6ac-e46ef6de6c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:54.208564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 534/1048] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:54 2022] GET /identity/v3/role_assignments?user.id=0422e6863c7147b79ea4d194e6e07154&scope.project.id=0ec77816151b45228e087023588839da&role.id=4e20c7e459304902a6face48dac75f06 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:54.208749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd92a8b-db48-4149-b6ac-e46ef6de6c24 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:54.222887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 515/1049] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:54.225485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffba6-f5de-4fd4-8893-a8aec9d92233 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:54.337455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffba6-f5de-4fd4-8893-a8aec9d92233 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:54.375250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43affaf4-f198-4ccb-9e4f-56a22676db24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:54.376137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43affaf4-f198-4ccb-9e4f-56a22676db24 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:54.376419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43affaf4-f198-4ccb-9e4f-56a22676db24 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:54.376691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43affaf4-f198-4ccb-9e4f-56a22676db24 None admin] PATH_INFO: `/v3/users/26fa569aa1614db18d23f7e5ecbf52de` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:54.391152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43affaf4-f198-4ccb-9e4f-56a22676db24 None admin] RBAC: Authorizing `identity:get_user(user_id=26fa569aa1614db18d23f7e5ecbf52de)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:54.392587 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43affaf4-f198-4ccb-9e4f-56a22676db24 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:54.395164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 535/1050] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:28:54 2022] GET /identity/v3/users/26fa569aa1614db18d23f7e5ecbf52de => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:54.400734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd92a8b-db48-4149-b6ac-e46ef6de6c24 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:54.498406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:54.505408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd92a8b-db48-4149-b6ac-e46ef6de6c24 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:54.539865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08311b-f5ca-477d-9fe0-3ecdc02ed789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:54.540947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08311b-f5ca-477d-9fe0-3ecdc02ed789 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:54.541788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08311b-f5ca-477d-9fe0-3ecdc02ed789 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:54.542070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08311b-f5ca-477d-9fe0-3ecdc02ed789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:54.616258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08311b-f5ca-477d-9fe0-3ecdc02ed789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:54.617736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08311b-f5ca-477d-9fe0-3ecdc02ed789 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:54.715854 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:54.727336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 516/1051] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:28:54.728562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43affaf4-f198-4ccb-9e4f-56a22676db24 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:54.744793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:54.832116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43affaf4-f198-4ccb-9e4f-56a22676db24 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:54.866617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13fdb2-3e3b-439e-a9bb-26f404a94126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:54.867440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13fdb2-3e3b-439e-a9bb-26f404a94126 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:54.867729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13fdb2-3e3b-439e-a9bb-26f404a94126 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:54.868010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13fdb2-3e3b-439e-a9bb-26f404a94126 None admin] PATH_INFO: `/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:54.869196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13fdb2-3e3b-439e-a9bb-26f404a94126 None admin] RBAC: Authorizing `identity:get_project(project_id=c3731c5b4fb745b694daa1d5f5c1f060)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:54.870690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13fdb2-3e3b-439e-a9bb-26f404a94126 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:54.877175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 536/1052] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:28:54 2022] GET /identity/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:54.879649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08311b-f5ca-477d-9fe0-3ecdc02ed789 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:54.979937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08311b-f5ca-477d-9fe0-3ecdc02ed789 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:55.014961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4f142-e41f-462a-8ec0-247337d2a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:55.015748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4f142-e41f-462a-8ec0-247337d2a06f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:55.016041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4f142-e41f-462a-8ec0-247337d2a06f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:55.016321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4f142-e41f-462a-8ec0-247337d2a06f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:55.017151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4f142-e41f-462a-8ec0-247337d2a06f None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=c3731c5b4fb745b694daa1d5f5c1f060, user.id=26fa569aa1614db18d23f7e5ecbf52de) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:55.017466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4f142-e41f-462a-8ec0-247337d2a06f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:55.019484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4f142-e41f-462a-8ec0-247337d2a06f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:55.030901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 517/1053] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:28:54 2022] GET /identity/v3/role_assignments?user.id=26fa569aa1614db18d23f7e5ecbf52de&scope.project.id=c3731c5b4fb745b694daa1d5f5c1f060&role.id=9312183c32b04118985c8316f33f3830 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:55.699915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ab6b-4bdd-432b-b875-95a8c1c30903 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:55.700238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ab6b-4bdd-432b-b875-95a8c1c30903 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:55.700488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ab6b-4bdd-432b-b875-95a8c1c30903 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:55.702001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 537/1054] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:55.707227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422555-0362-4607-9a0c-60cb648084ce None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:55.707686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422555-0362-4607-9a0c-60cb648084ce None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:55.707769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37422555-0362-4607-9a0c-60cb648084ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:55.725068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-37422555-0362-4607-9a0c-60cb648084ce None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:55.726250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-37422555-0362-4607-9a0c-60cb648084ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:55.782109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:55.794770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 518/1055] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:55.818484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328ab6b-4bdd-432b-b875-95a8c1c30903 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:55.900837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:55.920168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328ab6b-4bdd-432b-b875-95a8c1c30903 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:55.954927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c05674-99ab-4057-a9e5-051a647772ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:55.955802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c05674-99ab-4057-a9e5-051a647772ca None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:55.956154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c05674-99ab-4057-a9e5-051a647772ca None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:55.956436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c05674-99ab-4057-a9e5-051a647772ca None admin] PATH_INFO: `/v3/services/image` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:55.957095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c05674-99ab-4057-a9e5-051a647772ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:55.958454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c05674-99ab-4057-a9e5-051a647772ca None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-64c05674-99ab-4057-a9e5-051a647772ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:55.969932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:55.970940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 09:28:55.972622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:55.979032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 538/1056] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Jun 24 09:28:55 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:55.979232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37422555-0362-4607-9a0c-60cb648084ce None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:56.086582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37422555-0362-4607-9a0c-60cb648084ce None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:56.124801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c63d3-7014-4980-b7aa-563ac55c5808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:56.125478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c63d3-7014-4980-b7aa-563ac55c5808 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:56.125766 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c63d3-7014-4980-b7aa-563ac55c5808 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:56.126056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c63d3-7014-4980-b7aa-563ac55c5808 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:56.126755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c63d3-7014-4980-b7aa-563ac55c5808 None admin] RBAC: Adding query filter params (name=image) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:56.127092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c63d3-7014-4980-b7aa-563ac55c5808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:56.129193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c63d3-7014-4980-b7aa-563ac55c5808 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:56.138900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 519/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:56.140430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c05674-99ab-4057-a9e5-051a647772ca None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:56.244002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c05674-99ab-4057-a9e5-051a647772ca None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:56.244355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6453-d28c-4c1a-82ce-a60ebdff8a4e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:56.244652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6453-d28c-4c1a-82ce-a60ebdff8a4e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:56.244935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6453-d28c-4c1a-82ce-a60ebdff8a4e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:56.246551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 520/1058] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:28:56.251374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170f6e-0496-411a-a31f-09d1dbbee342 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:56.251666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170f6e-0496-411a-a31f-09d1dbbee342 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:56.251949 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a170f6e-0496-411a-a31f-09d1dbbee342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:56.269462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7a170f6e-0496-411a-a31f-09d1dbbee342 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:56.270648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7a170f6e-0496-411a-a31f-09d1dbbee342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:56.280744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cb836-35c3-42d3-ade5-6e338e7b8e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:56.281421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cb836-35c3-42d3-ade5-6e338e7b8e70 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:56.281737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cb836-35c3-42d3-ade5-6e338e7b8e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:56.282036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cb836-35c3-42d3-ade5-6e338e7b8e70 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:56.282746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cb836-35c3-42d3-ade5-6e338e7b8e70 None admin] RBAC: Adding query filter params (type=image) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:56.283069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cb836-35c3-42d3-ade5-6e338e7b8e70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:56.284465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cb836-35c3-42d3-ade5-6e338e7b8e70 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:56.289512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 539/1059] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:56.295264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cb836-35c3-42d3-ade5-6e338e7b8e70 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:56.308321 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:56.321124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:56.339978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 521/1060] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:56.364023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a170f6e-0496-411a-a31f-09d1dbbee342 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:56.403978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cb836-35c3-42d3-ade5-6e338e7b8e70 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:56.440137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a90bfc-cf27-4384-950b-36939d42ab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:56.440898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a90bfc-cf27-4384-950b-36939d42ab4e None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:56.441186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a90bfc-cf27-4384-950b-36939d42ab4e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:56.441471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a90bfc-cf27-4384-950b-36939d42ab4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:56.442220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a90bfc-cf27-4384-950b-36939d42ab4e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:56.443636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a90bfc-cf27-4384-950b-36939d42ab4e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:56.475022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a170f6e-0496-411a-a31f-09d1dbbee342 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:56.509555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc11358-2960-4376-98fb-83a41376ef65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:56.510382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc11358-2960-4376-98fb-83a41376ef65 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:56.510670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc11358-2960-4376-98fb-83a41376ef65 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:56.510977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc11358-2960-4376-98fb-83a41376ef65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:56.522926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc11358-2960-4376-98fb-83a41376ef65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:56.527490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 540/1061] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 09:28:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3dc11358-2960-4376-98fb-83a41376ef65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:56.530018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:56.531029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:28:56.531884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:56.535227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 522/1062] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 09:28:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:56.538860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a90bfc-cf27-4384-950b-36939d42ab4e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:56.619471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:56.664976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a90bfc-cf27-4384-950b-36939d42ab4e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:56.704590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62695eb4-24e6-456f-bde7-84ebade45539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:56.705263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62695eb4-24e6-456f-bde7-84ebade45539 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:56.705548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62695eb4-24e6-456f-bde7-84ebade45539 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:56.705877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62695eb4-24e6-456f-bde7-84ebade45539 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:56.707811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62695eb4-24e6-456f-bde7-84ebade45539 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:56.708126 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62695eb4-24e6-456f-bde7-84ebade45539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:56.709493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62695eb4-24e6-456f-bde7-84ebade45539 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:56.718500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 541/1063] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 09:28:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:56.739739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc11358-2960-4376-98fb-83a41376ef65 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:56.774466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:56.830550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc11358-2960-4376-98fb-83a41376ef65 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:56.866294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe82c44-f75e-4030-a868-7365c7f8f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:56.867116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82c44-f75e-4030-a868-7365c7f8f8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:56.867402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82c44-f75e-4030-a868-7365c7f8f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:56.867676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe82c44-f75e-4030-a868-7365c7f8f8a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:56.878963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe82c44-f75e-4030-a868-7365c7f8f8a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:56.880417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe82c44-f75e-4030-a868-7365c7f8f8a0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-cfe82c44-f75e-4030-a868-7365c7f8f8a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:56.898503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:56.899696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:56.900954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:56.900954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:56.900954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:56.900954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:56.902920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 523/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:56.905725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62695eb4-24e6-456f-bde7-84ebade45539 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.009478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62695eb4-24e6-456f-bde7-84ebade45539 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.032793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:57.044057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b1912-17f7-429a-b7a9-a1b97a6de343 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.044233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4d7df-280d-42a5-b7f0-af4d459d1c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.044330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b1912-17f7-429a-b7a9-a1b97a6de343 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.045567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b1912-17f7-429a-b7a9-a1b97a6de343 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.045660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d7df-280d-42a5-b7f0-af4d459d1c16 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.045660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d7df-280d-42a5-b7f0-af4d459d1c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.045660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4d7df-280d-42a5-b7f0-af4d459d1c16 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.046065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4d7df-280d-42a5-b7f0-af4d459d1c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:57.046249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 524/1065] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:57.046437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4d7df-280d-42a5-b7f0-af4d459d1c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.047939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4d7df-280d-42a5-b7f0-af4d459d1c16 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.051742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7850d-ce80-4b20-9cb6-b2e3b843aa9b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.052030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7850d-ce80-4b20-9cb6-b2e3b843aa9b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.052405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7850d-ce80-4b20-9cb6-b2e3b843aa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.061853 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 542/1066] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:57.069460 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4d7df-280d-42a5-b7f0-af4d459d1c16 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.070808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-aec7850d-ce80-4b20-9cb6-b2e3b843aa9b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:57.072015 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-aec7850d-ce80-4b20-9cb6-b2e3b843aa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:57.143307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 525/1067] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:28:57.166018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7850d-ce80-4b20-9cb6-b2e3b843aa9b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.179555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4d7df-280d-42a5-b7f0-af4d459d1c16 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.194779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:57.216734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b965d-bfd5-4ced-9106-da2378cd410d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.217528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b965d-bfd5-4ced-9106-da2378cd410d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.217810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b965d-bfd5-4ced-9106-da2378cd410d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.218095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b965d-bfd5-4ced-9106-da2378cd410d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.226377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b965d-bfd5-4ced-9106-da2378cd410d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.228111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b965d-bfd5-4ced-9106-da2378cd410d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-235b965d-bfd5-4ced-9106-da2378cd410d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:28:57.244455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:57.245450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:28:57.246494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:57.248822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 543/1068] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:57.254109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b965d-bfd5-4ced-9106-da2378cd410d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.275434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7850d-ce80-4b20-9cb6-b2e3b843aa9b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.304592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:57.313565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175cad-271e-40ce-9cbf-33483ff48791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.314324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175cad-271e-40ce-9cbf-33483ff48791 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.319433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175cad-271e-40ce-9cbf-33483ff48791 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.319433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175cad-271e-40ce-9cbf-33483ff48791 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.326124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175cad-271e-40ce-9cbf-33483ff48791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-de175cad-271e-40ce-9cbf-33483ff48791 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:28:57.334450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:57.335646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:57.336485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 526/1069] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:57.342058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175cad-271e-40ce-9cbf-33483ff48791 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.370286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b965d-bfd5-4ced-9106-da2378cd410d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.410541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a169f08-b932-479d-8463-67e36d7d1d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.411404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169f08-b932-479d-8463-67e36d7d1d75 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.411672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169f08-b932-479d-8463-67e36d7d1d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.411946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a169f08-b932-479d-8463-67e36d7d1d75 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.413193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169f08-b932-479d-8463-67e36d7d1d75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:57.413193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169f08-b932-479d-8463-67e36d7d1d75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.414523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a169f08-b932-479d-8463-67e36d7d1d75 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.432569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 544/1070] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:57.434126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:57.438001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a169f08-b932-479d-8463-67e36d7d1d75 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.450088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175cad-271e-40ce-9cbf-33483ff48791 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.491606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b8744-28bb-4df2-b3fb-eba561d3dae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.492798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b8744-28bb-4df2-b3fb-eba561d3dae7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.493090 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b8744-28bb-4df2-b3fb-eba561d3dae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.493656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b8744-28bb-4df2-b3fb-eba561d3dae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.494418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b8744-28bb-4df2-b3fb-eba561d3dae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:57.494995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b8744-28bb-4df2-b3fb-eba561d3dae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.497118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b8744-28bb-4df2-b3fb-eba561d3dae7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.510998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 527/1071] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:57.514468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b8744-28bb-4df2-b3fb-eba561d3dae7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.548457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a169f08-b932-479d-8463-67e36d7d1d75 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.550696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:57.590947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefebf1f-6f3a-45c0-bd74-a110f213a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.594118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefebf1f-6f3a-45c0-bd74-a110f213a31b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.594118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefebf1f-6f3a-45c0-bd74-a110f213a31b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.594118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefebf1f-6f3a-45c0-bd74-a110f213a31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.603508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefebf1f-6f3a-45c0-bd74-a110f213a31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.605070 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefebf1f-6f3a-45c0-bd74-a110f213a31b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-cefebf1f-6f3a-45c0-bd74-a110f213a31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:57.623490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:57.624549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:57.625481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:57.625481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:57.625481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:57.625481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:57.625481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 545/1072] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:28:57.626010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b8744-28bb-4df2-b3fb-eba561d3dae7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.630816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefebf1f-6f3a-45c0-bd74-a110f213a31b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.666944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587a8ee-fba7-4612-b0cd-aa63b7550a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.667830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587a8ee-fba7-4612-b0cd-aa63b7550a60 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.668115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587a8ee-fba7-4612-b0cd-aa63b7550a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.668395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587a8ee-fba7-4612-b0cd-aa63b7550a60 None admin] PATH_INFO: `/v3/users/26fa569aa1614db18d23f7e5ecbf52de` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.669604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587a8ee-fba7-4612-b0cd-aa63b7550a60 None admin] RBAC: Authorizing `identity:get_user(user_id=26fa569aa1614db18d23f7e5ecbf52de)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.671070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587a8ee-fba7-4612-b0cd-aa63b7550a60 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.672706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 528/1073] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/users/26fa569aa1614db18d23f7e5ecbf52de => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:28:57.678996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587a8ee-fba7-4612-b0cd-aa63b7550a60 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.700386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:57.750556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefebf1f-6f3a-45c0-bd74-a110f213a31b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.787056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587a8ee-fba7-4612-b0cd-aa63b7550a60 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.788479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14efab-19f5-4099-9119-0c91908e1e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.789543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14efab-19f5-4099-9119-0c91908e1e4d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.789892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14efab-19f5-4099-9119-0c91908e1e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.790169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14efab-19f5-4099-9119-0c91908e1e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.790905 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14efab-19f5-4099-9119-0c91908e1e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:57.791213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14efab-19f5-4099-9119-0c91908e1e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.792569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14efab-19f5-4099-9119-0c91908e1e4d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.810082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 546/1074] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:57.810793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14efab-19f5-4099-9119-0c91908e1e4d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.825663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193fb02-10ef-49b6-8881-76efc5b90383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.826519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193fb02-10ef-49b6-8881-76efc5b90383 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.826799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193fb02-10ef-49b6-8881-76efc5b90383 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.827111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193fb02-10ef-49b6-8881-76efc5b90383 None admin] PATH_INFO: `/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.827520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:57.828329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193fb02-10ef-49b6-8881-76efc5b90383 None admin] RBAC: Authorizing `identity:get_project(project_id=c3731c5b4fb745b694daa1d5f5c1f060)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.829759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193fb02-10ef-49b6-8881-76efc5b90383 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.836595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 529/1075] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:57.837396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193fb02-10ef-49b6-8881-76efc5b90383 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:57.920368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14efab-19f5-4099-9119-0c91908e1e4d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.927848 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:57.943749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193fb02-10ef-49b6-8881-76efc5b90383 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:57.956743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7c9b0-3783-4981-990c-2ee685ece9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.957844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7c9b0-3783-4981-990c-2ee685ece9dc None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.958436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7c9b0-3783-4981-990c-2ee685ece9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.958942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7c9b0-3783-4981-990c-2ee685ece9dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.966273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7c9b0-3783-4981-990c-2ee685ece9dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.967743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7c9b0-3783-4981-990c-2ee685ece9dc None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.978634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad1865-e3bd-4cf9-b1d0-841ac5f6f90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:57.979542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1865-e3bd-4cf9-b1d0-841ac5f6f90e None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:57.979824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1865-e3bd-4cf9-b1d0-841ac5f6f90e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:57.980206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad1865-e3bd-4cf9-b1d0-841ac5f6f90e None admin] PATH_INFO: `/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060/users/26fa569aa1614db18d23f7e5ecbf52de/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:57.982145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad1865-e3bd-4cf9-b1d0-841ac5f6f90e None admin] RBAC: Authorizing `identity:create_grant(project_id=c3731c5b4fb745b694daa1d5f5c1f060, user_id=26fa569aa1614db18d23f7e5ecbf52de, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-33d7c9b0-3783-4981-990c-2ee685ece9dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:28:57.982595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:57.983505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:57.984609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:28:57.984609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:28:57.984609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:28:57.984609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:28:57.984609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:28:57.984609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:28:57.984609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:28:57.984609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:28:57.985211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad1865-e3bd-4cf9-b1d0-841ac5f6f90e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:57.985293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 547/1076] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:57.990265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7c9b0-3783-4981-990c-2ee685ece9dc None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:58.055064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 530/1077] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:57 2022] PUT /identity/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060/users/26fa569aa1614db18d23f7e5ecbf52de/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:58.067089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:58.096120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7c9b0-3783-4981-990c-2ee685ece9dc None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:58.137275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c9786-3daa-4561-8464-8d3eac0d373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:58.137950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9786-3daa-4561-8464-8d3eac0d373f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:58.138230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9786-3daa-4561-8464-8d3eac0d373f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:58.138502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c9786-3daa-4561-8464-8d3eac0d373f None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:58.139350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c9786-3daa-4561-8464-8d3eac0d373f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:58.139662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c9786-3daa-4561-8464-8d3eac0d373f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:58.141123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c9786-3daa-4561-8464-8d3eac0d373f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:58.159565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 548/1078] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:28:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:28:58.161477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad1865-e3bd-4cf9-b1d0-841ac5f6f90e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:58.275800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad1865-e3bd-4cf9-b1d0-841ac5f6f90e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:58.311078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b76756-6631-4b84-b372-57a97da08744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:58.311978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b76756-6631-4b84-b372-57a97da08744 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:58.312259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b76756-6631-4b84-b372-57a97da08744 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:58.312534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b76756-6631-4b84-b372-57a97da08744 None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/0422e6863c7147b79ea4d194e6e07154/roles/4e20c7e459304902a6face48dac75f06` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:58.314811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b76756-6631-4b84-b372-57a97da08744 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=0422e6863c7147b79ea4d194e6e07154, role_id=4e20c7e459304902a6face48dac75f06)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:58.316842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b76756-6631-4b84-b372-57a97da08744 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:58.424212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 531/1079] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:28:58 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/0422e6863c7147b79ea4d194e6e07154/roles/4e20c7e459304902a6face48dac75f06 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:58.646394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60f51-c03e-4c87-86a0-20392c40e2f0 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:58.646720 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60f51-c03e-4c87-86a0-20392c40e2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:58.647013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b60f51-c03e-4c87-86a0-20392c40e2f0 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:58.648589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 549/1080] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:28:58.653625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb309a-5737-4471-9535-a447c8b1a140 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:58.653976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb309a-5737-4471-9535-a447c8b1a140 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:58.654261 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb309a-5737-4471-9535-a447c8b1a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:58.660805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:58.671762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-51bb309a-5737-4471-9535-a447c8b1a140 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:58.673000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-51bb309a-5737-4471-9535-a447c8b1a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:58.745579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 532/1081] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:28:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:28:58.768275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b60f51-c03e-4c87-86a0-20392c40e2f0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:58.887666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b60f51-c03e-4c87-86a0-20392c40e2f0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:58.922044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf366f-c717-42b7-87a1-6ab3f95cdd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:58.922660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf366f-c717-42b7-87a1-6ab3f95cdd7d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:58.922974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf366f-c717-42b7-87a1-6ab3f95cdd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:58.923323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf366f-c717-42b7-87a1-6ab3f95cdd7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:58.927123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:59.004745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf366f-c717-42b7-87a1-6ab3f95cdd7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:59.006190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf366f-c717-42b7-87a1-6ab3f95cdd7d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:59.110542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 550/1082] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:28:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:28:59.111677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb309a-5737-4471-9535-a447c8b1a140 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:59.213364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb309a-5737-4471-9535-a447c8b1a140 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:59.248503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70081433-6e4d-4b7b-9491-0ec3707567fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:59.249290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70081433-6e4d-4b7b-9491-0ec3707567fe None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:59.249572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70081433-6e4d-4b7b-9491-0ec3707567fe None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:59.249848 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70081433-6e4d-4b7b-9491-0ec3707567fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:59.251740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:59.261460 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70081433-6e4d-4b7b-9491-0ec3707567fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:59.263017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70081433-6e4d-4b7b-9491-0ec3707567fe None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-70081433-6e4d-4b7b-9491-0ec3707567fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:28:59.280207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:28:59.281085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:28:59.281968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:28:59.281968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:28:59.281968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:28:59.281968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:28:59.281968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 533/1083] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:28:59.288202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf366f-c717-42b7-87a1-6ab3f95cdd7d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:59.321748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:59.387346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf366f-c717-42b7-87a1-6ab3f95cdd7d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:59.420693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f489945-2e6b-45a3-8d4e-3b3a5538682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:59.421350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f489945-2e6b-45a3-8d4e-3b3a5538682d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:59.421631 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f489945-2e6b-45a3-8d4e-3b3a5538682d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:59.421902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f489945-2e6b-45a3-8d4e-3b3a5538682d None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:59.422610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f489945-2e6b-45a3-8d4e-3b3a5538682d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:28:59.422940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f489945-2e6b-45a3-8d4e-3b3a5538682d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:59.424378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f489945-2e6b-45a3-8d4e-3b3a5538682d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:59.436146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 551/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:00.119740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2ab8-0aa9-4c5b-9eed-63030bd75f83 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.120270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2ab8-0aa9-4c5b-9eed-63030bd75f83 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.120363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c2ab8-0aa9-4c5b-9eed-63030bd75f83 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.121668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 534/1085] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:00.127020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0d718-d849-44c0-bc19-55ddd1f2b1fd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.127426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0d718-d849-44c0-bc19-55ddd1f2b1fd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.127591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0d718-d849-44c0-bc19-55ddd1f2b1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.145351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-eed0d718-d849-44c0-bc19-55ddd1f2b1fd None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:00.146538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eed0d718-d849-44c0-bc19-55ddd1f2b1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:00.212393 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 552/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:00.236749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c2ab8-0aa9-4c5b-9eed-63030bd75f83 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:00.337917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c2ab8-0aa9-4c5b-9eed-63030bd75f83 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:00.372454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5655333e-be1f-4cf4-9ca5-b1c58468c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:00.373172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655333e-be1f-4cf4-9ca5-b1c58468c830 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.373453 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655333e-be1f-4cf4-9ca5-b1c58468c830 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.373729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5655333e-be1f-4cf4-9ca5-b1c58468c830 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.383933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5655333e-be1f-4cf4-9ca5-b1c58468c830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-5655333e-be1f-4cf4-9ca5-b1c58468c830 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:29:00.391503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:00.392621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:00.393607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 535/1087] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:29:00.398765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0d718-d849-44c0-bc19-55ddd1f2b1fd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:00.423034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:00.467053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343fcc-b1d0-451b-b206-bf7d6531aad3 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.467345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343fcc-b1d0-451b-b206-bf7d6531aad3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.467637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4343fcc-b1d0-451b-b206-bf7d6531aad3 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.468993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 536/1088] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:00.474657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f88dba-4568-49d8-8a34-c72f9d3bff30 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.474984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f88dba-4568-49d8-8a34-c72f9d3bff30 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.475275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f88dba-4568-49d8-8a34-c72f9d3bff30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.492712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e3f88dba-4568-49d8-8a34-c72f9d3bff30 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:00.493905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e3f88dba-4568-49d8-8a34-c72f9d3bff30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:00.499834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0d718-d849-44c0-bc19-55ddd1f2b1fd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:00.533210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd616fe5-ffe5-4e53-bc1c-1c323d499ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:00.533969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd616fe5-ffe5-4e53-bc1c-1c323d499ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.534924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd616fe5-ffe5-4e53-bc1c-1c323d499ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.535355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd616fe5-ffe5-4e53-bc1c-1c323d499ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.536094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd616fe5-ffe5-4e53-bc1c-1c323d499ce4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:00.536405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd616fe5-ffe5-4e53-bc1c-1c323d499ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:00.537728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:00.537895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd616fe5-ffe5-4e53-bc1c-1c323d499ce4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:00.546875 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 553/1089] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:00.551984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd616fe5-ffe5-4e53-bc1c-1c323d499ce4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:00.562798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 537/1090] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:29:00.587134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f88dba-4568-49d8-8a34-c72f9d3bff30 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:00.636080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:00.650759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd616fe5-ffe5-4e53-bc1c-1c323d499ce4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:00.684437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe559ce3-6dee-4eec-b941-9941fb100725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:00.685315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe559ce3-6dee-4eec-b941-9941fb100725 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.685603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe559ce3-6dee-4eec-b941-9941fb100725 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.685878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe559ce3-6dee-4eec-b941-9941fb100725 None admin] PATH_INFO: `/v3/users/26fa569aa1614db18d23f7e5ecbf52de` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.687102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe559ce3-6dee-4eec-b941-9941fb100725 None admin] RBAC: Authorizing `identity:get_user(user_id=26fa569aa1614db18d23f7e5ecbf52de)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:00.688528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe559ce3-6dee-4eec-b941-9941fb100725 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:00.689061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f88dba-4568-49d8-8a34-c72f9d3bff30 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:00.690204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 554/1091] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:00 2022] GET /identity/v3/users/26fa569aa1614db18d23f7e5ecbf52de => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:00.696016 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe559ce3-6dee-4eec-b941-9941fb100725 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:00.725003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100d7ea-56fb-47e5-b0cc-ae1fc2edc4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:00.725814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100d7ea-56fb-47e5-b0cc-ae1fc2edc4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.726095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100d7ea-56fb-47e5-b0cc-ae1fc2edc4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.726375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100d7ea-56fb-47e5-b0cc-ae1fc2edc4a6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.736686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100d7ea-56fb-47e5-b0cc-ae1fc2edc4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d100d7ea-56fb-47e5-b0cc-ae1fc2edc4a6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:29:00.745124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:00.746071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:00.746965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 538/1092] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 09:29:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:29:00.752312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100d7ea-56fb-47e5-b0cc-ae1fc2edc4a6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:00.787767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:00.799838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe559ce3-6dee-4eec-b941-9941fb100725 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:00.833229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596f55-a653-494d-9f0c-2b2e6ee23c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:00.833870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596f55-a653-494d-9f0c-2b2e6ee23c0c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.834151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596f55-a653-494d-9f0c-2b2e6ee23c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.834423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25596f55-a653-494d-9f0c-2b2e6ee23c0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.851480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100d7ea-56fb-47e5-b0cc-ae1fc2edc4a6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:00.859699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:00.885393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0698c-5058-40b2-8c95-4f49e2c47b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:00.886045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0698c-5058-40b2-8c95-4f49e2c47b0a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:00.886375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0698c-5058-40b2-8c95-4f49e2c47b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:00.886602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0698c-5058-40b2-8c95-4f49e2c47b0a None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:00.887378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0698c-5058-40b2-8c95-4f49e2c47b0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:00.887690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0698c-5058-40b2-8c95-4f49e2c47b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:00.889054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0698c-5058-40b2-8c95-4f49e2c47b0a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:00.897398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 539/1093] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 09:29:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:00.902955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0698c-5058-40b2-8c95-4f49e2c47b0a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:00.904308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25596f55-a653-494d-9f0c-2b2e6ee23c0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:00.905946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25596f55-a653-494d-9f0c-2b2e6ee23c0c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:00.995951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:00.999871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0698c-5058-40b2-8c95-4f49e2c47b0a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:01.006378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 555/1094] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:29:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 09:29:01.010369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596f55-a653-494d-9f0c-2b2e6ee23c0c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:01.035853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaed6c-bab8-4505-aa23-f3648e94f1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:01.036625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaed6c-bab8-4505-aa23-f3648e94f1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:01.036906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaed6c-bab8-4505-aa23-f3648e94f1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:01.037181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaed6c-bab8-4505-aa23-f3648e94f1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:01.047120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaed6c-bab8-4505-aa23-f3648e94f1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:01.048547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edaed6c-bab8-4505-aa23-f3648e94f1e6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:01.064632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3edaed6c-bab8-4505-aa23-f3648e94f1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:29:01.066569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:01.067586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:01.068860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:29:01.068860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:29:01.068860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:29:01.068860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:01.068860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 540/1095] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:29:01.073398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaed6c-bab8-4505-aa23-f3648e94f1e6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:01.109696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25596f55-a653-494d-9f0c-2b2e6ee23c0c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:01.146588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bd548-503c-4233-9384-90fca663567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:01.147824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bd548-503c-4233-9384-90fca663567f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:01.147824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bd548-503c-4233-9384-90fca663567f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:01.147990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bd548-503c-4233-9384-90fca663567f None admin] PATH_INFO: `/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:01.149116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bd548-503c-4233-9384-90fca663567f None admin] RBAC: Authorizing `identity:get_project(project_id=c3731c5b4fb745b694daa1d5f5c1f060)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:01.150560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bd548-503c-4233-9384-90fca663567f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:01.152299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 556/1096] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:01 2022] GET /identity/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:01.158767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bd548-503c-4233-9384-90fca663567f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:01.187326 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edaed6c-bab8-4505-aa23-f3648e94f1e6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:01.222463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63757c78-152f-4c3c-b8f7-b4fd0a997d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:01.223153 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63757c78-152f-4c3c-b8f7-b4fd0a997d51 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:01.223445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63757c78-152f-4c3c-b8f7-b4fd0a997d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:01.223724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63757c78-152f-4c3c-b8f7-b4fd0a997d51 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:01.224449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63757c78-152f-4c3c-b8f7-b4fd0a997d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:01.224762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63757c78-152f-4c3c-b8f7-b4fd0a997d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:01.226138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63757c78-152f-4c3c-b8f7-b4fd0a997d51 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:01.238321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 541/1097] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:01.244311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63757c78-152f-4c3c-b8f7-b4fd0a997d51 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:01.259548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:01.260795 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bd548-503c-4233-9384-90fca663567f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:01.285161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:01.297000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94378af0-94e8-4c3d-8b68-86bf7ce5f354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:01.297744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94378af0-94e8-4c3d-8b68-86bf7ce5f354 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:01.298093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94378af0-94e8-4c3d-8b68-86bf7ce5f354 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:01.298431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94378af0-94e8-4c3d-8b68-86bf7ce5f354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:01.299377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94378af0-94e8-4c3d-8b68-86bf7ce5f354 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=c3731c5b4fb745b694daa1d5f5c1f060, user.id=26fa569aa1614db18d23f7e5ecbf52de) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:01.300283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94378af0-94e8-4c3d-8b68-86bf7ce5f354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:01.301953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94378af0-94e8-4c3d-8b68-86bf7ce5f354 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:01.308609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 557/1098] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:29:01 2022] GET /identity/v3/role_assignments?user.id=26fa569aa1614db18d23f7e5ecbf52de&scope.project.id=c3731c5b4fb745b694daa1d5f5c1f060&role.id=9312183c32b04118985c8316f33f3830 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:01.357000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63757c78-152f-4c3c-b8f7-b4fd0a997d51 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:01.400256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4ab33-3e54-42e1-87b0-44d43e52c92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:01.400992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ab33-3e54-42e1-87b0-44d43e52c92d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:01.401291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ab33-3e54-42e1-87b0-44d43e52c92d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:01.401574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4ab33-3e54-42e1-87b0-44d43e52c92d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:01.411554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4ab33-3e54-42e1-87b0-44d43e52c92d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:01.413045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4ab33-3e54-42e1-87b0-44d43e52c92d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-beb4ab33-3e54-42e1-87b0-44d43e52c92d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:29:01.434068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:01.435327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:01.436280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 542/1099] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 09:29:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:29:01.441515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94378af0-94e8-4c3d-8b68-86bf7ce5f354 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:01.554792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94378af0-94e8-4c3d-8b68-86bf7ce5f354 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:01.590125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfb4be-82d1-4241-be9b-6933456a4152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:01.592677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfb4be-82d1-4241-be9b-6933456a4152 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:01.592677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfb4be-82d1-4241-be9b-6933456a4152 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:01.592677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfb4be-82d1-4241-be9b-6933456a4152 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:01.592677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfb4be-82d1-4241-be9b-6933456a4152 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:01.592677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfb4be-82d1-4241-be9b-6933456a4152 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:01.593951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfb4be-82d1-4241-be9b-6933456a4152 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:01.614050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 558/1100] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 09:29:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:01.619926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4ab33-3e54-42e1-87b0-44d43e52c92d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:01.692007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:01.725529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4ab33-3e54-42e1-87b0-44d43e52c92d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:01.763288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae127c8-dfe1-44c5-a67a-59d006e9ddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:01.763968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae127c8-dfe1-44c5-a67a-59d006e9ddfb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:01.764254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae127c8-dfe1-44c5-a67a-59d006e9ddfb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:01.764534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae127c8-dfe1-44c5-a67a-59d006e9ddfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:01.837501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae127c8-dfe1-44c5-a67a-59d006e9ddfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:01.839000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae127c8-dfe1-44c5-a67a-59d006e9ddfb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:01.909759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:01.954076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 543/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:29:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 09:29:01.960959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfb4be-82d1-4241-be9b-6933456a4152 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:02.016782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:02.070585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfb4be-82d1-4241-be9b-6933456a4152 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:02.103454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda43ed-bcf6-412d-99e4-c6f3945067d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:02.104245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda43ed-bcf6-412d-99e4-c6f3945067d2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:02.104530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda43ed-bcf6-412d-99e4-c6f3945067d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:02.104813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda43ed-bcf6-412d-99e4-c6f3945067d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:02.116057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda43ed-bcf6-412d-99e4-c6f3945067d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:02.117507 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda43ed-bcf6-412d-99e4-c6f3945067d2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-3fda43ed-bcf6-412d-99e4-c6f3945067d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:29:02.136040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:02.136974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:02.137877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:29:02.137877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:29:02.137877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:29:02.137877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:29:02.137877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 559/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:29:02.142867 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae127c8-dfe1-44c5-a67a-59d006e9ddfb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:02.239648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae127c8-dfe1-44c5-a67a-59d006e9ddfb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:02.273697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763d0b5-acf4-402a-a8c6-8b694c7e6c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:02.274352 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d0b5-acf4-402a-a8c6-8b694c7e6c72 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:02.274644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d0b5-acf4-402a-a8c6-8b694c7e6c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:02.274950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d0b5-acf4-402a-a8c6-8b694c7e6c72 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:02.275667 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763d0b5-acf4-402a-a8c6-8b694c7e6c72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:02.275975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763d0b5-acf4-402a-a8c6-8b694c7e6c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:02.277344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763d0b5-acf4-402a-a8c6-8b694c7e6c72 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:02.288471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 544/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:02.294219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda43ed-bcf6-412d-99e4-c6f3945067d2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:02.387057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:02.392582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda43ed-bcf6-412d-99e4-c6f3945067d2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:02.426047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035de67-a38a-4e6d-a5a1-cf6de4f74222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:02.426863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035de67-a38a-4e6d-a5a1-cf6de4f74222 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:02.427159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035de67-a38a-4e6d-a5a1-cf6de4f74222 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:02.427439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035de67-a38a-4e6d-a5a1-cf6de4f74222 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:02.434253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035de67-a38a-4e6d-a5a1-cf6de4f74222 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:02.435728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035de67-a38a-4e6d-a5a1-cf6de4f74222 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-9035de67-a38a-4e6d-a5a1-cf6de4f74222 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:29:02.449667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:02.450607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:02.456225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:29:02.456225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:29:02.456225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:29:02.456225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:29:02.456225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:29:02.456225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:29:02.456225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:29:02.456225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:29:02.456225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 560/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:29:02.456916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763d0b5-acf4-402a-a8c6-8b694c7e6c72 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:02.489838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:02.559968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763d0b5-acf4-402a-a8c6-8b694c7e6c72 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:02.593539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f5b79-474e-4ad2-8a43-8f08ab58d667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:02.593659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f5b79-474e-4ad2-8a43-8f08ab58d667 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:02.593937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f5b79-474e-4ad2-8a43-8f08ab58d667 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:02.594218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f5b79-474e-4ad2-8a43-8f08ab58d667 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:02.595032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f5b79-474e-4ad2-8a43-8f08ab58d667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:02.595348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f5b79-474e-4ad2-8a43-8f08ab58d667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:02.597333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f5b79-474e-4ad2-8a43-8f08ab58d667 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:02.610037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 545/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:02.617090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035de67-a38a-4e6d-a5a1-cf6de4f74222 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:02.713068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035de67-a38a-4e6d-a5a1-cf6de4f74222 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:02.747726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dd481-49a5-44ef-bbae-e4baab3ed6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:02.748327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dd481-49a5-44ef-bbae-e4baab3ed6ab None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:02.748619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dd481-49a5-44ef-bbae-e4baab3ed6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:02.748901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dd481-49a5-44ef-bbae-e4baab3ed6ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:02.749725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dd481-49a5-44ef-bbae-e4baab3ed6ab None admin] RBAC: Adding query filter params (role.id=4e20c7e459304902a6face48dac75f06, scope.project.id=0ec77816151b45228e087023588839da, user.id=0422e6863c7147b79ea4d194e6e07154) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:02.750077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dd481-49a5-44ef-bbae-e4baab3ed6ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:02.751533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dd481-49a5-44ef-bbae-e4baab3ed6ab None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:02.757472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 561/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:29:02 2022] GET /identity/v3/role_assignments?user.id=0422e6863c7147b79ea4d194e6e07154&scope.project.id=0ec77816151b45228e087023588839da&role.id=4e20c7e459304902a6face48dac75f06 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:03.427278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29f444-1858-4464-8b36-ae10d0579e42 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:03.427798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29f444-1858-4464-8b36-ae10d0579e42 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:03.427917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e29f444-1858-4464-8b36-ae10d0579e42 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:03.429208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 546/1107] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:03.434835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ad25-8edd-4cfe-a31e-31d87e9964e0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:03.435264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ad25-8edd-4cfe-a31e-31d87e9964e0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:03.435424 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084ad25-8edd-4cfe-a31e-31d87e9964e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:03.452988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d084ad25-8edd-4cfe-a31e-31d87e9964e0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:03.454164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d084ad25-8edd-4cfe-a31e-31d87e9964e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:03.469370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:03.525648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 562/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:03.551546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29f444-1858-4464-8b36-ae10d0579e42 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:03.645801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:03.655790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e29f444-1858-4464-8b36-ae10d0579e42 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:03.689063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4745f4e-287f-4793-a1e9-9c0caf758248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:03.689783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745f4e-287f-4793-a1e9-9c0caf758248 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:03.690064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745f4e-287f-4793-a1e9-9c0caf758248 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:03.690832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4745f4e-287f-4793-a1e9-9c0caf758248 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:03.692020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4745f4e-287f-4793-a1e9-9c0caf758248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:03.693707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4745f4e-287f-4793-a1e9-9c0caf758248 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:03.695502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 547/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:03.701312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084ad25-8edd-4cfe-a31e-31d87e9964e0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:03.800668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084ad25-8edd-4cfe-a31e-31d87e9964e0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:03.833831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f0797-3d3d-4709-a5c1-b0af3c982a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:03.834487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f0797-3d3d-4709-a5c1-b0af3c982a25 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:03.834770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f0797-3d3d-4709-a5c1-b0af3c982a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:03.835074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f0797-3d3d-4709-a5c1-b0af3c982a25 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:03.835783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f0797-3d3d-4709-a5c1-b0af3c982a25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:03.837206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f0797-3d3d-4709-a5c1-b0af3c982a25 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:03.911069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 563/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:29:03 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:29:06.004140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9955b4-252d-47b5-bc8d-7768ed8870bf None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:06.004663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9955b4-252d-47b5-bc8d-7768ed8870bf None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:06.004663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9955b4-252d-47b5-bc8d-7768ed8870bf None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:06.005972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 548/1111] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:06.011081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac6a8d-0c1d-47af-8020-13e0cbdf8297 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:06.011463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac6a8d-0c1d-47af-8020-13e0cbdf8297 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:06.011649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac6a8d-0c1d-47af-8020-13e0cbdf8297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:06.023670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:06.028857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-25ac6a8d-0c1d-47af-8020-13e0cbdf8297 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:06.030036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-25ac6a8d-0c1d-47af-8020-13e0cbdf8297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:06.095719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 564/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:06.119976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9955b4-252d-47b5-bc8d-7768ed8870bf None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:06.219594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9955b4-252d-47b5-bc8d-7768ed8870bf None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:06.252468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3bc58-3034-4a02-8841-08cd4f5cdccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:06.253861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3bc58-3034-4a02-8841-08cd4f5cdccc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:06.254196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3bc58-3034-4a02-8841-08cd4f5cdccc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:06.254424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3bc58-3034-4a02-8841-08cd4f5cdccc None admin] PATH_INFO: `/v3/roles/3aed2722fbf34ba2bb24b1cb29d49004` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:06.255933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3bc58-3034-4a02-8841-08cd4f5cdccc None admin] RBAC: Authorizing `identity:get_role(role_id=3aed2722fbf34ba2bb24b1cb29d49004)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:06.257317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3bc58-3034-4a02-8841-08cd4f5cdccc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:06.258686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 549/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:06 2022] GET /identity/v3/roles/3aed2722fbf34ba2bb24b1cb29d49004 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:06.264573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac6a8d-0c1d-47af-8020-13e0cbdf8297 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:06.359552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac6a8d-0c1d-47af-8020-13e0cbdf8297 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:06.392596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b7678-6835-4cb4-b812-ad99ac639a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:06.394045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b7678-6835-4cb4-b812-ad99ac639a5f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:06.394437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b7678-6835-4cb4-b812-ad99ac639a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:06.394728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b7678-6835-4cb4-b812-ad99ac639a5f None admin] PATH_INFO: `/v3/users/e6081ec50b424ffe88a7aeb9f7e6fd3c` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:06.397456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:06.407583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b7678-6835-4cb4-b812-ad99ac639a5f None admin] RBAC: Authorizing `identity:get_user(user_id=e6081ec50b424ffe88a7aeb9f7e6fd3c)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:06.409031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b7678-6835-4cb4-b812-ad99ac639a5f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:06.410684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 565/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:06 2022] GET /identity/v3/users/e6081ec50b424ffe88a7aeb9f7e6fd3c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:06.416413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3bc58-3034-4a02-8841-08cd4f5cdccc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:06.443637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:06.515119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3bc58-3034-4a02-8841-08cd4f5cdccc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:06.547479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010abfde-70f9-43a8-95b4-5db0decb17b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:06.548137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010abfde-70f9-43a8-95b4-5db0decb17b3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:06.548409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010abfde-70f9-43a8-95b4-5db0decb17b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:06.548689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010abfde-70f9-43a8-95b4-5db0decb17b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:06.615410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010abfde-70f9-43a8-95b4-5db0decb17b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:06.616892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010abfde-70f9-43a8-95b4-5db0decb17b3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:06.642602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:06.714249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 550/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:29:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:29:06.720440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b7678-6835-4cb4-b812-ad99ac639a5f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:06.819430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b7678-6835-4cb4-b812-ad99ac639a5f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:06.852387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb1638-905b-4aeb-9ac5-103e44f670f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:06.853238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb1638-905b-4aeb-9ac5-103e44f670f3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:06.853515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb1638-905b-4aeb-9ac5-103e44f670f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:06.853785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb1638-905b-4aeb-9ac5-103e44f670f3 None admin] PATH_INFO: `/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:06.854978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb1638-905b-4aeb-9ac5-103e44f670f3 None admin] RBAC: Authorizing `identity:get_project(project_id=c3731c5b4fb745b694daa1d5f5c1f060)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:06.856391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecb1638-905b-4aeb-9ac5-103e44f670f3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:06.858058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 566/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:06 2022] GET /identity/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:06.865415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010abfde-70f9-43a8-95b4-5db0decb17b3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:06.963210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010abfde-70f9-43a8-95b4-5db0decb17b3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:06.988832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:06.997247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3a5e3-b5ec-4ce5-b5e8-28f680f0467e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:06.997899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3a5e3-b5ec-4ce5-b5e8-28f680f0467e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:06.998185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3a5e3-b5ec-4ce5-b5e8-28f680f0467e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:06.998464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3a5e3-b5ec-4ce5-b5e8-28f680f0467e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:06.999322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3a5e3-b5ec-4ce5-b5e8-28f680f0467e None admin] RBAC: Adding query filter params (role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=c3731c5b4fb745b694daa1d5f5c1f060, user.id=e6081ec50b424ffe88a7aeb9f7e6fd3c) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:06.999728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3a5e3-b5ec-4ce5-b5e8-28f680f0467e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:07.001167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3a5e3-b5ec-4ce5-b5e8-28f680f0467e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:07.006475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 551/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:29:06 2022] GET /identity/v3/role_assignments?user.id=e6081ec50b424ffe88a7aeb9f7e6fd3c&scope.project.id=c3731c5b4fb745b694daa1d5f5c1f060&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:09.014942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93aff2-8d5a-4c94-b625-801b02c158f0 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.015441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93aff2-8d5a-4c94-b625-801b02c158f0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.015441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93aff2-8d5a-4c94-b625-801b02c158f0 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.016808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 567/1118] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:09.022539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d2d08-116c-4b5d-9099-daf1c7dd002a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.022974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d2d08-116c-4b5d-9099-daf1c7dd002a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.023127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d2d08-116c-4b5d-9099-daf1c7dd002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.041053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-cd2d2d08-116c-4b5d-9099-daf1c7dd002a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:09.042224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cd2d2d08-116c-4b5d-9099-daf1c7dd002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:09.106511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 552/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:09.130497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93aff2-8d5a-4c94-b625-801b02c158f0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.191004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:09.228909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93aff2-8d5a-4c94-b625-801b02c158f0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.261878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f62ed-caed-42b6-aad0-567846ffdd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.262717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f62ed-caed-42b6-aad0-567846ffdd3c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.263037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f62ed-caed-42b6-aad0-567846ffdd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.263315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f62ed-caed-42b6-aad0-567846ffdd3c None admin] PATH_INFO: `/v3/roles/3aed2722fbf34ba2bb24b1cb29d49004` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.264777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f62ed-caed-42b6-aad0-567846ffdd3c None admin] RBAC: Authorizing `identity:get_role(role_id=3aed2722fbf34ba2bb24b1cb29d49004)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.266186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f62ed-caed-42b6-aad0-567846ffdd3c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.267532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 568/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:09 2022] GET /identity/v3/roles/3aed2722fbf34ba2bb24b1cb29d49004 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:09.274332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d2d08-116c-4b5d-9099-daf1c7dd002a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.374612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d2d08-116c-4b5d-9099-daf1c7dd002a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.394108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:09.407568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f0fa-e0ea-4f63-96b2-7222722c2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.408428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f0fa-e0ea-4f63-96b2-7222722c2259 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.408712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f0fa-e0ea-4f63-96b2-7222722c2259 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.409656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0f0fa-e0ea-4f63-96b2-7222722c2259 None admin] PATH_INFO: `/v3/users/e6081ec50b424ffe88a7aeb9f7e6fd3c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.410871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f0fa-e0ea-4f63-96b2-7222722c2259 None admin] RBAC: Authorizing `identity:get_user(user_id=e6081ec50b424ffe88a7aeb9f7e6fd3c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.412307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0f0fa-e0ea-4f63-96b2-7222722c2259 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.413909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 553/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:09 2022] GET /identity/v3/users/e6081ec50b424ffe88a7aeb9f7e6fd3c => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:09.419827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f62ed-caed-42b6-aad0-567846ffdd3c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.516282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f62ed-caed-42b6-aad0-567846ffdd3c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.544724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:09.550431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39791e55-c041-484c-b652-44e5f3321fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.551309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39791e55-c041-484c-b652-44e5f3321fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.551599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39791e55-c041-484c-b652-44e5f3321fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.551876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39791e55-c041-484c-b652-44e5f3321fb7 None admin] PATH_INFO: `/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.553198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39791e55-c041-484c-b652-44e5f3321fb7 None admin] RBAC: Authorizing `identity:get_project(project_id=c3731c5b4fb745b694daa1d5f5c1f060)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.554617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39791e55-c041-484c-b652-44e5f3321fb7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.556421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 569/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:09 2022] GET /identity/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:09.562295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f0fa-e0ea-4f63-96b2-7222722c2259 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.660517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0f0fa-e0ea-4f63-96b2-7222722c2259 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.693048 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1757823-8a25-47e0-9f12-d5610db81d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.693919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1757823-8a25-47e0-9f12-d5610db81d53 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.694199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1757823-8a25-47e0-9f12-d5610db81d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.694472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1757823-8a25-47e0-9f12-d5610db81d53 None admin] PATH_INFO: `/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060/users/e6081ec50b424ffe88a7aeb9f7e6fd3c/roles/3aed2722fbf34ba2bb24b1cb29d49004` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.696654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1757823-8a25-47e0-9f12-d5610db81d53 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3731c5b4fb745b694daa1d5f5c1f060, user_id=e6081ec50b424ffe88a7aeb9f7e6fd3c, role_id=3aed2722fbf34ba2bb24b1cb29d49004)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.698077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1757823-8a25-47e0-9f12-d5610db81d53 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.786254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 554/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:29:09 2022] PUT /identity/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060/users/e6081ec50b424ffe88a7aeb9f7e6fd3c/roles/3aed2722fbf34ba2bb24b1cb29d49004 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:11.805138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3d7f4-0131-40b5-87dd-a93b46459dd4 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.805656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3d7f4-0131-40b5-87dd-a93b46459dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.805747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3d7f4-0131-40b5-87dd-a93b46459dd4 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.807092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 570/1124] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:11.812271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8865b0-6590-4530-93f2-24c4337d8f8b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.812657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8865b0-6590-4530-93f2-24c4337d8f8b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.812828 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8865b0-6590-4530-93f2-24c4337d8f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.829565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2c8865b0-6590-4530-93f2-24c4337d8f8b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:11.830740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2c8865b0-6590-4530-93f2-24c4337d8f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:11.873796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:11.896154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 555/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:11.920161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3d7f4-0131-40b5-87dd-a93b46459dd4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:12.019255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3d7f4-0131-40b5-87dd-a93b46459dd4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:12.052205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac624607-2932-46a9-8747-10257671bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:12.053060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac624607-2932-46a9-8747-10257671bd47 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.053342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac624607-2932-46a9-8747-10257671bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.053614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac624607-2932-46a9-8747-10257671bd47 None admin] PATH_INFO: `/v3/roles/3aed2722fbf34ba2bb24b1cb29d49004` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.055103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac624607-2932-46a9-8747-10257671bd47 None admin] RBAC: Authorizing `identity:get_role(role_id=3aed2722fbf34ba2bb24b1cb29d49004)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:12.056465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac624607-2932-46a9-8747-10257671bd47 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:12.057808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 571/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:11 2022] GET /identity/v3/roles/3aed2722fbf34ba2bb24b1cb29d49004 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:12.063584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8865b0-6590-4530-93f2-24c4337d8f8b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:12.160565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8865b0-6590-4530-93f2-24c4337d8f8b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:12.193238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca3a9-0913-4acd-8618-2acd0bc3438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:12.194095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca3a9-0913-4acd-8618-2acd0bc3438e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.194380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca3a9-0913-4acd-8618-2acd0bc3438e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.194656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deca3a9-0913-4acd-8618-2acd0bc3438e None admin] PATH_INFO: `/v3/users/e6081ec50b424ffe88a7aeb9f7e6fd3c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.195862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deca3a9-0913-4acd-8618-2acd0bc3438e None admin] RBAC: Authorizing `identity:get_user(user_id=e6081ec50b424ffe88a7aeb9f7e6fd3c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:12.197292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deca3a9-0913-4acd-8618-2acd0bc3438e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:12.198893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 556/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:12 2022] GET /identity/v3/users/e6081ec50b424ffe88a7aeb9f7e6fd3c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:12.204469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac624607-2932-46a9-8747-10257671bd47 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:12.269036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:12.302401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac624607-2932-46a9-8747-10257671bd47 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:12.335706 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470571-7e71-4c7c-ac76-2b876b5e49a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:12.336362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470571-7e71-4c7c-ac76-2b876b5e49a2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.336670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470571-7e71-4c7c-ac76-2b876b5e49a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.336937 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31470571-7e71-4c7c-ac76-2b876b5e49a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.402527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470571-7e71-4c7c-ac76-2b876b5e49a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:12.404006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31470571-7e71-4c7c-ac76-2b876b5e49a2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:12.465219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:12.499825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 572/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:29:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:29:12.506712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca3a9-0913-4acd-8618-2acd0bc3438e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:12.552185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:12.605319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deca3a9-0913-4acd-8618-2acd0bc3438e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:12.639558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07502fc8-af6f-4f86-ac89-8b2fea998031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:12.640408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07502fc8-af6f-4f86-ac89-8b2fea998031 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.640694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07502fc8-af6f-4f86-ac89-8b2fea998031 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.640973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07502fc8-af6f-4f86-ac89-8b2fea998031 None admin] PATH_INFO: `/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.642138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07502fc8-af6f-4f86-ac89-8b2fea998031 None admin] RBAC: Authorizing `identity:get_project(project_id=c3731c5b4fb745b694daa1d5f5c1f060)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:12.643788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07502fc8-af6f-4f86-ac89-8b2fea998031 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:12.645314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 557/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:12 2022] GET /identity/v3/projects/c3731c5b4fb745b694daa1d5f5c1f060 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:12.651394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470571-7e71-4c7c-ac76-2b876b5e49a2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:12.746354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31470571-7e71-4c7c-ac76-2b876b5e49a2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:12.779122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ae9f-8ae5-4e78-8ebd-235450296aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:12.779762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ae9f-8ae5-4e78-8ebd-235450296aef None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.780044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ae9f-8ae5-4e78-8ebd-235450296aef None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.780317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ae9f-8ae5-4e78-8ebd-235450296aef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.781134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539ae9f-8ae5-4e78-8ebd-235450296aef None admin] RBAC: Adding query filter params (role.id=3aed2722fbf34ba2bb24b1cb29d49004, scope.project.id=c3731c5b4fb745b694daa1d5f5c1f060, user.id=e6081ec50b424ffe88a7aeb9f7e6fd3c) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:12.781445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539ae9f-8ae5-4e78-8ebd-235450296aef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:12.782876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539ae9f-8ae5-4e78-8ebd-235450296aef None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:12.788515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 573/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:29:12 2022] GET /identity/v3/role_assignments?user.id=e6081ec50b424ffe88a7aeb9f7e6fd3c&scope.project.id=c3731c5b4fb745b694daa1d5f5c1f060&role.id=3aed2722fbf34ba2bb24b1cb29d49004 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:14.817953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c4db-4241-46ff-a3c1-b48f82b2fc94 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:14.818473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c4db-4241-46ff-a3c1-b48f82b2fc94 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:14.818559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c4db-4241-46ff-a3c1-b48f82b2fc94 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:14.819934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 558/1131] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:14.825014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545964b9-dd22-49c9-8089-83641908d49d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:14.825426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545964b9-dd22-49c9-8089-83641908d49d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:14.825575 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545964b9-dd22-49c9-8089-83641908d49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:14.842008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-545964b9-dd22-49c9-8089-83641908d49d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:14.843266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-545964b9-dd22-49c9-8089-83641908d49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:14.866692 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:14.907977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 574/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:14.931893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c4db-4241-46ff-a3c1-b48f82b2fc94 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:15.031639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c4db-4241-46ff-a3c1-b48f82b2fc94 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:15.045031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:15.064598 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f474e-b177-432d-82cc-ea2826c0a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:15.065936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f474e-b177-432d-82cc-ea2826c0a17d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:15.066220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f474e-b177-432d-82cc-ea2826c0a17d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:15.066497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f474e-b177-432d-82cc-ea2826c0a17d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:15.067703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f474e-b177-432d-82cc-ea2826c0a17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:15.069131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f474e-b177-432d-82cc-ea2826c0a17d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:15.070727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 559/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:29:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:15.076481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545964b9-dd22-49c9-8089-83641908d49d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:15.172326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545964b9-dd22-49c9-8089-83641908d49d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:15.204662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802a3bf-cbdb-4c6b-bd8a-b17a0aa00403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:15.205310 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a3bf-cbdb-4c6b-bd8a-b17a0aa00403 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:15.205596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a3bf-cbdb-4c6b-bd8a-b17a0aa00403 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:15.205873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802a3bf-cbdb-4c6b-bd8a-b17a0aa00403 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:15.206585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802a3bf-cbdb-4c6b-bd8a-b17a0aa00403 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:15.208039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802a3bf-cbdb-4c6b-bd8a-b17a0aa00403 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:15.301582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 575/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:29:15 2022] POST /identity/v3/projects => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:17.361498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9efdad-1557-4481-a7e4-71e5e8a62204 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:17.362493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9efdad-1557-4481-a7e4-71e5e8a62204 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:17.362493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9efdad-1557-4481-a7e4-71e5e8a62204 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:17.363834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 560/1135] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:17.369045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be717d6e-d397-4065-b5c9-0dad51ef22ef None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:17.369488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be717d6e-d397-4065-b5c9-0dad51ef22ef None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:17.369588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be717d6e-d397-4065-b5c9-0dad51ef22ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:17.386485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-be717d6e-d397-4065-b5c9-0dad51ef22ef None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:17.387685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-be717d6e-d397-4065-b5c9-0dad51ef22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:17.395349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:17.454026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 576/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:17.479049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9efdad-1557-4481-a7e4-71e5e8a62204 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:17.578748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9efdad-1557-4481-a7e4-71e5e8a62204 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:17.613091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b8b9e-388a-46c6-84a4-f6b534b08621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:17.613813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b8b9e-388a-46c6-84a4-f6b534b08621 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:17.614092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b8b9e-388a-46c6-84a4-f6b534b08621 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:17.614363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b8b9e-388a-46c6-84a4-f6b534b08621 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:17.615528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b8b9e-388a-46c6-84a4-f6b534b08621 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:17.616952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b8b9e-388a-46c6-84a4-f6b534b08621 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:17.618538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 561/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:29:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:17.624211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be717d6e-d397-4065-b5c9-0dad51ef22ef None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:17.719591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be717d6e-d397-4065-b5c9-0dad51ef22ef None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:17.754014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8421f2bb-7968-4306-b7df-fd2a7c35f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:17.754670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421f2bb-7968-4306-b7df-fd2a7c35f74f None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:17.754984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421f2bb-7968-4306-b7df-fd2a7c35f74f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:17.755263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8421f2bb-7968-4306-b7df-fd2a7c35f74f None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:17.755975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421f2bb-7968-4306-b7df-fd2a7c35f74f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:17.757408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8421f2bb-7968-4306-b7df-fd2a7c35f74f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:17.826303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:17.832423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 577/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:29:17 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:29:19.880222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc844a-1a21-48fc-a8d8-9b81411e8c54 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:19.880746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc844a-1a21-48fc-a8d8-9b81411e8c54 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:19.880746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc844a-1a21-48fc-a8d8-9b81411e8c54 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:19.882057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 562/1139] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:19.887279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946431-1016-4895-bd03-4b5d31eb7990 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:19.887693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946431-1016-4895-bd03-4b5d31eb7990 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:19.887835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1946431-1016-4895-bd03-4b5d31eb7990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:19.904591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b1946431-1016-4895-bd03-4b5d31eb7990 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:19.905750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b1946431-1016-4895-bd03-4b5d31eb7990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:19.970138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 578/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:19.994125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc844a-1a21-48fc-a8d8-9b81411e8c54 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:20.044103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:20.093861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc844a-1a21-48fc-a8d8-9b81411e8c54 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:20.126474 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ea764-776a-44c5-a7c8-74eb3a49d0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:20.127271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ea764-776a-44c5-a7c8-74eb3a49d0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:20.127551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ea764-776a-44c5-a7c8-74eb3a49d0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:20.128364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ea764-776a-44c5-a7c8-74eb3a49d0e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:20.138159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ea764-776a-44c5-a7c8-74eb3a49d0e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-de2ea764-776a-44c5-a7c8-74eb3a49d0e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:29:20.146258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:20.147487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:20.148406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 563/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:29:20.153301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946431-1016-4895-bd03-4b5d31eb7990 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:20.249768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1946431-1016-4895-bd03-4b5d31eb7990 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:20.277699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:20.285658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae0223-baba-46aa-b23e-584e0f65aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:20.290510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae0223-baba-46aa-b23e-584e0f65aeea None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:20.290510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae0223-baba-46aa-b23e-584e0f65aeea None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:20.290510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae0223-baba-46aa-b23e-584e0f65aeea None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:20.290510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae0223-baba-46aa-b23e-584e0f65aeea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:20.290510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae0223-baba-46aa-b23e-584e0f65aeea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:20.290510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae0223-baba-46aa-b23e-584e0f65aeea None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:20.297227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 579/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:29:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:20.302635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ea764-776a-44c5-a7c8-74eb3a49d0e9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:20.400740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ea764-776a-44c5-a7c8-74eb3a49d0e9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:20.410624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:20.433055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc930c7-9f66-4653-95b8-b18875dcc4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:20.433946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc930c7-9f66-4653-95b8-b18875dcc4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:20.434226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc930c7-9f66-4653-95b8-b18875dcc4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:20.434501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc930c7-9f66-4653-95b8-b18875dcc4c7 None admin] PATH_INFO: `/v3/users/481841649563484882348e99c40e0ad5` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:20.448096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc930c7-9f66-4653-95b8-b18875dcc4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=481841649563484882348e99c40e0ad5)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:20.449529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc930c7-9f66-4653-95b8-b18875dcc4c7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:20.451163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 564/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:20 2022] GET /identity/v3/users/481841649563484882348e99c40e0ad5 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:20.456865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae0223-baba-46aa-b23e-584e0f65aeea None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:20.553509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae0223-baba-46aa-b23e-584e0f65aeea None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:20.585975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd053cb4-93e1-48e9-a6e5-4e2c138e444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:20.586616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd053cb4-93e1-48e9-a6e5-4e2c138e444c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:20.587007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd053cb4-93e1-48e9-a6e5-4e2c138e444c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:20.587298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd053cb4-93e1-48e9-a6e5-4e2c138e444c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:20.643010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:20.652899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd053cb4-93e1-48e9-a6e5-4e2c138e444c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:20.654285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd053cb4-93e1-48e9-a6e5-4e2c138e444c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:20.749372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 580/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:29:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 09:29:20.756470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc930c7-9f66-4653-95b8-b18875dcc4c7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:20.889254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc930c7-9f66-4653-95b8-b18875dcc4c7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:20.922367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce12384-f987-4c76-a368-5c7fed9e41f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:20.923181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce12384-f987-4c76-a368-5c7fed9e41f7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:20.923463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce12384-f987-4c76-a368-5c7fed9e41f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:20.923744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce12384-f987-4c76-a368-5c7fed9e41f7 None admin] PATH_INFO: `/v3/projects/40d17de9144a461f957b02514f04d3d6` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:20.926031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce12384-f987-4c76-a368-5c7fed9e41f7 None admin] RBAC: Authorizing `identity:get_project(project_id=40d17de9144a461f957b02514f04d3d6)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:20.927484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce12384-f987-4c76-a368-5c7fed9e41f7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:20.929136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 565/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:20 2022] GET /identity/v3/projects/40d17de9144a461f957b02514f04d3d6 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:20.935141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd053cb4-93e1-48e9-a6e5-4e2c138e444c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:21.022947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:21.032063 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd053cb4-93e1-48e9-a6e5-4e2c138e444c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:21.066127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81dc8-083d-4504-b6ca-8b07902de93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:21.066767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81dc8-083d-4504-b6ca-8b07902de93f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:21.067149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81dc8-083d-4504-b6ca-8b07902de93f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:21.067425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81dc8-083d-4504-b6ca-8b07902de93f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:21.068268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81dc8-083d-4504-b6ca-8b07902de93f None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=40d17de9144a461f957b02514f04d3d6, user.id=481841649563484882348e99c40e0ad5) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:21.068577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81dc8-083d-4504-b6ca-8b07902de93f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:21.069984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81dc8-083d-4504-b6ca-8b07902de93f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:21.075233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 581/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:29:20 2022] GET /identity/v3/role_assignments?user.id=481841649563484882348e99c40e0ad5&scope.project.id=40d17de9144a461f957b02514f04d3d6&role.id=9312183c32b04118985c8316f33f3830 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:23.091684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d5d90-d04c-4d35-bdf4-d39dd952f2d7 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:23.092210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d5d90-d04c-4d35-bdf4-d39dd952f2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:23.092301 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d5d90-d04c-4d35-bdf4-d39dd952f2d7 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:23.093605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 566/1147] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:23.098895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c8798-c206-42c5-b842-c6785bc33835 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:23.099320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c8798-c206-42c5-b842-c6785bc33835 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:23.099485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c8798-c206-42c5-b842-c6785bc33835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:23.117175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9e8c8798-c206-42c5-b842-c6785bc33835 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:23.118394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9e8c8798-c206-42c5-b842-c6785bc33835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:23.182646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 582/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:23.205705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d5d90-d04c-4d35-bdf4-d39dd952f2d7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:23.241412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:23.305028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d5d90-d04c-4d35-bdf4-d39dd952f2d7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:23.340007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969873-b001-48fd-80ea-a3d5e8f8e976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:23.340782 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969873-b001-48fd-80ea-a3d5e8f8e976 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:23.341067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969873-b001-48fd-80ea-a3d5e8f8e976 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:23.341347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b969873-b001-48fd-80ea-a3d5e8f8e976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:23.351877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b969873-b001-48fd-80ea-a3d5e8f8e976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-2b969873-b001-48fd-80ea-a3d5e8f8e976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:29:23.359400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:23.360494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:23.361397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 567/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:29:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:29:23.367880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c8798-c206-42c5-b842-c6785bc33835 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:23.449263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:23.464432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c8798-c206-42c5-b842-c6785bc33835 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:23.498180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4908440-59d1-4738-ab90-ddf65f77c6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:23.498831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4908440-59d1-4738-ab90-ddf65f77c6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:23.499144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4908440-59d1-4738-ab90-ddf65f77c6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:23.499423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4908440-59d1-4738-ab90-ddf65f77c6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:23.500154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4908440-59d1-4738-ab90-ddf65f77c6c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:23.500457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4908440-59d1-4738-ab90-ddf65f77c6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:23.501803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4908440-59d1-4738-ab90-ddf65f77c6c0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:23.510614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 583/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:29:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:23.516295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969873-b001-48fd-80ea-a3d5e8f8e976 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:23.607788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:23.614332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b969873-b001-48fd-80ea-a3d5e8f8e976 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:23.647926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af264d4-aadf-4f5a-b6dc-9d0ebb57d38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:23.648789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af264d4-aadf-4f5a-b6dc-9d0ebb57d38a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:23.649074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af264d4-aadf-4f5a-b6dc-9d0ebb57d38a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:23.649350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af264d4-aadf-4f5a-b6dc-9d0ebb57d38a None admin] PATH_INFO: `/v3/users/481841649563484882348e99c40e0ad5` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:23.650537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af264d4-aadf-4f5a-b6dc-9d0ebb57d38a None admin] RBAC: Authorizing `identity:get_user(user_id=481841649563484882348e99c40e0ad5)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:23.652007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af264d4-aadf-4f5a-b6dc-9d0ebb57d38a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:23.653616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 568/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:23 2022] GET /identity/v3/users/481841649563484882348e99c40e0ad5 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:23.659440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4908440-59d1-4738-ab90-ddf65f77c6c0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:23.755957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4908440-59d1-4738-ab90-ddf65f77c6c0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:23.788014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c53af-1f7b-43f9-bb3c-046f39e5dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:23.788854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c53af-1f7b-43f9-bb3c-046f39e5dc63 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:23.789136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c53af-1f7b-43f9-bb3c-046f39e5dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:23.789409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c53af-1f7b-43f9-bb3c-046f39e5dc63 None admin] PATH_INFO: `/v3/projects/40d17de9144a461f957b02514f04d3d6` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:23.790559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c53af-1f7b-43f9-bb3c-046f39e5dc63 None admin] RBAC: Authorizing `identity:get_project(project_id=40d17de9144a461f957b02514f04d3d6)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:23.791998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c53af-1f7b-43f9-bb3c-046f39e5dc63 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:23.793645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 584/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:23 2022] GET /identity/v3/projects/40d17de9144a461f957b02514f04d3d6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:23.799489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af264d4-aadf-4f5a-b6dc-9d0ebb57d38a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:23.895741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af264d4-aadf-4f5a-b6dc-9d0ebb57d38a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:23.928942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21bb71-cb71-40dc-8eef-6c4b565f50fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:23.929807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21bb71-cb71-40dc-8eef-6c4b565f50fc None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:23.930093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21bb71-cb71-40dc-8eef-6c4b565f50fc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:23.930370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21bb71-cb71-40dc-8eef-6c4b565f50fc None admin] PATH_INFO: `/v3/projects/40d17de9144a461f957b02514f04d3d6/users/481841649563484882348e99c40e0ad5/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:23.932331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21bb71-cb71-40dc-8eef-6c4b565f50fc None admin] RBAC: Authorizing `identity:create_grant(project_id=40d17de9144a461f957b02514f04d3d6, user_id=481841649563484882348e99c40e0ad5, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:23.933751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21bb71-cb71-40dc-8eef-6c4b565f50fc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:24.030976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 569/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:29:23 2022] PUT /identity/v3/projects/40d17de9144a461f957b02514f04d3d6/users/481841649563484882348e99c40e0ad5/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:26.046137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47772d45-35aa-4fbf-9286-3fe5ca205544 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.046666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47772d45-35aa-4fbf-9286-3fe5ca205544 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.046666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47772d45-35aa-4fbf-9286-3fe5ca205544 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.048073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 585/1154] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:26.053745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93ea32-4dc1-45f1-847f-26e53515f5eb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.054146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93ea32-4dc1-45f1-847f-26e53515f5eb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.054302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93ea32-4dc1-45f1-847f-26e53515f5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.071419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ff93ea32-4dc1-45f1-847f-26e53515f5eb None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:26.072591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ff93ea32-4dc1-45f1-847f-26e53515f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:26.093422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:26.145396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 570/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:26.169035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47772d45-35aa-4fbf-9286-3fe5ca205544 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.184813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:26.267902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47772d45-35aa-4fbf-9286-3fe5ca205544 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.300943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89034402-7480-4ce1-b029-5dbd5503bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.301662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89034402-7480-4ce1-b029-5dbd5503bb82 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.301945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89034402-7480-4ce1-b029-5dbd5503bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.302218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89034402-7480-4ce1-b029-5dbd5503bb82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.312231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89034402-7480-4ce1-b029-5dbd5503bb82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-89034402-7480-4ce1-b029-5dbd5503bb82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:29:26.319914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:26.320881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:29:26.321755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 586/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:29:26.327037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93ea32-4dc1-45f1-847f-26e53515f5eb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.423842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff93ea32-4dc1-45f1-847f-26e53515f5eb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.456505 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ace61-ae0a-4d46-9fc5-65c8ab6641b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.457150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ace61-ae0a-4d46-9fc5-65c8ab6641b5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.457433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ace61-ae0a-4d46-9fc5-65c8ab6641b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.457708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ace61-ae0a-4d46-9fc5-65c8ab6641b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.458451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ace61-ae0a-4d46-9fc5-65c8ab6641b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:26.458759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ace61-ae0a-4d46-9fc5-65c8ab6641b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.460160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ace61-ae0a-4d46-9fc5-65c8ab6641b5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.467983 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 571/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:26.474242 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89034402-7480-4ce1-b029-5dbd5503bb82 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.550940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:26.574322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89034402-7480-4ce1-b029-5dbd5503bb82 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.608967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512a7f4-e8d6-43dd-970c-8da836d31033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.609838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512a7f4-e8d6-43dd-970c-8da836d31033 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.610120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512a7f4-e8d6-43dd-970c-8da836d31033 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.610396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512a7f4-e8d6-43dd-970c-8da836d31033 None admin] PATH_INFO: `/v3/users/481841649563484882348e99c40e0ad5` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.611589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512a7f4-e8d6-43dd-970c-8da836d31033 None admin] RBAC: Authorizing `identity:get_user(user_id=481841649563484882348e99c40e0ad5)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.613277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512a7f4-e8d6-43dd-970c-8da836d31033 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.614939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 587/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:26 2022] GET /identity/v3/users/481841649563484882348e99c40e0ad5 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:26.620617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ace61-ae0a-4d46-9fc5-65c8ab6641b5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.638747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:26.718964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ace61-ae0a-4d46-9fc5-65c8ab6641b5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.753903 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b164-c3cf-4e4f-9897-7f6aa4329ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.754602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b164-c3cf-4e4f-9897-7f6aa4329ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.754915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b164-c3cf-4e4f-9897-7f6aa4329ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.755195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294b164-c3cf-4e4f-9897-7f6aa4329ea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.821287 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294b164-c3cf-4e4f-9897-7f6aa4329ea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.822736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294b164-c3cf-4e4f-9897-7f6aa4329ea0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.839386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:26.917588 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 572/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:29:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:29:26.923417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512a7f4-e8d6-43dd-970c-8da836d31033 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.020245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512a7f4-e8d6-43dd-970c-8da836d31033 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.053274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41463d8-9354-4b36-85a0-bf70c26a52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.054110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41463d8-9354-4b36-85a0-bf70c26a52a4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.054387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41463d8-9354-4b36-85a0-bf70c26a52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.054655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41463d8-9354-4b36-85a0-bf70c26a52a4 None admin] PATH_INFO: `/v3/projects/40d17de9144a461f957b02514f04d3d6` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.055839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41463d8-9354-4b36-85a0-bf70c26a52a4 None admin] RBAC: Authorizing `identity:get_project(project_id=40d17de9144a461f957b02514f04d3d6)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.057243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41463d8-9354-4b36-85a0-bf70c26a52a4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.058910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 588/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:26 2022] GET /identity/v3/projects/40d17de9144a461f957b02514f04d3d6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:27.064817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b164-c3cf-4e4f-9897-7f6aa4329ea0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.163298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294b164-c3cf-4e4f-9897-7f6aa4329ea0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.179241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:27.197051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf872f3-96b3-4b70-9bdc-c854dfa8f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.197700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf872f3-96b3-4b70-9bdc-c854dfa8f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.197984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf872f3-96b3-4b70-9bdc-c854dfa8f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.198260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf872f3-96b3-4b70-9bdc-c854dfa8f6c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.199124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf872f3-96b3-4b70-9bdc-c854dfa8f6c3 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=40d17de9144a461f957b02514f04d3d6, user.id=481841649563484882348e99c40e0ad5) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:27.199437 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf872f3-96b3-4b70-9bdc-c854dfa8f6c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.200861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf872f3-96b3-4b70-9bdc-c854dfa8f6c3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.206628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 573/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:29:27 2022] GET /identity/v3/role_assignments?user.id=481841649563484882348e99c40e0ad5&scope.project.id=40d17de9144a461f957b02514f04d3d6&role.id=9312183c32b04118985c8316f33f3830 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:29.240770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ddfa-5e61-47a9-a051-b83c41d7f70f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:29.241335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ddfa-5e61-47a9-a051-b83c41d7f70f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:29.241335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ddfa-5e61-47a9-a051-b83c41d7f70f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:29.242683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 589/1162] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:29.247884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341a8ef-e85d-4857-8557-947a8e4b4f21 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:29.248299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341a8ef-e85d-4857-8557-947a8e4b4f21 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:29.248441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341a8ef-e85d-4857-8557-947a8e4b4f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:29.265156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7341a8ef-e85d-4857-8557-947a8e4b4f21 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:29.266330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7341a8ef-e85d-4857-8557-947a8e4b4f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:29.331693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 574/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:29.354558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ddfa-5e61-47a9-a051-b83c41d7f70f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:29.367614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:29.453978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ddfa-5e61-47a9-a051-b83c41d7f70f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:29.487581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ea7a3-9ff4-44ef-b758-c5fe99436dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:29.488222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ea7a3-9ff4-44ef-b758-c5fe99436dee None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:29.488510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ea7a3-9ff4-44ef-b758-c5fe99436dee None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:29.488790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ea7a3-9ff4-44ef-b758-c5fe99436dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:29.553298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ea7a3-9ff4-44ef-b758-c5fe99436dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:29.554741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ea7a3-9ff4-44ef-b758-c5fe99436dee None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:29.565218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:29.650359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 590/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:29:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:29:29.656368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341a8ef-e85d-4857-8557-947a8e4b4f21 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:29.753952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341a8ef-e85d-4857-8557-947a8e4b4f21 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:29.764682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:29.788882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6833e3-4fe7-4393-baff-02c2af7ba986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:29.789687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6833e3-4fe7-4393-baff-02c2af7ba986 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:29.789975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6833e3-4fe7-4393-baff-02c2af7ba986 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:29.790254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6833e3-4fe7-4393-baff-02c2af7ba986 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:29.796888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6833e3-4fe7-4393-baff-02c2af7ba986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:29.798338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6833e3-4fe7-4393-baff-02c2af7ba986 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-9f6833e3-4fe7-4393-baff-02c2af7ba986 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:29.812589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:29.813791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:29.814823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 575/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:29:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:29:29.820246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ea7a3-9ff4-44ef-b758-c5fe99436dee None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:29.916568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ea7a3-9ff4-44ef-b758-c5fe99436dee None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:29.926972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:29.950258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17903b4c-0437-4dd4-8238-2e676211374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:29.951167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17903b4c-0437-4dd4-8238-2e676211374a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:29.951672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17903b4c-0437-4dd4-8238-2e676211374a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:29.951973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17903b4c-0437-4dd4-8238-2e676211374a None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:29.952966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17903b4c-0437-4dd4-8238-2e676211374a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:29.953285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17903b4c-0437-4dd4-8238-2e676211374a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:29.954655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17903b4c-0437-4dd4-8238-2e676211374a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:29.962242 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 591/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 09:29:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:31.949197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4249c-a789-425e-be3c-d8e6f76c06d7 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:31.949695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4249c-a789-425e-be3c-d8e6f76c06d7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:31.949695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4249c-a789-425e-be3c-d8e6f76c06d7 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:31.951058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 576/1167] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:31.956820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d931-82da-4e6f-83c2-ca145e042530 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:31.957220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d931-82da-4e6f-83c2-ca145e042530 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:31.957400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00d931-82da-4e6f-83c2-ca145e042530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:31.974350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bc00d931-82da-4e6f-83c2-ca145e042530 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:31.975592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bc00d931-82da-4e6f-83c2-ca145e042530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:32.040317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 592/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 09:29:32.063423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4249c-a789-425e-be3c-d8e6f76c06d7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:32.162591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4249c-a789-425e-be3c-d8e6f76c06d7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:32.195941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa47c63-8610-4498-bcd2-a730f4f6e45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:32.196585 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47c63-8610-4498-bcd2-a730f4f6e45b None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:32.196870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47c63-8610-4498-bcd2-a730f4f6e45b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:32.197151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa47c63-8610-4498-bcd2-a730f4f6e45b None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:32.197887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa47c63-8610-4498-bcd2-a730f4f6e45b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:32.199342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa47c63-8610-4498-bcd2-a730f4f6e45b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:32.317428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 577/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Fri Jun 24 09:29:32 2022] POST /identity/v3/domains => generated 267 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:34.390448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af449-77ba-4533-907c-22c132660de0 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:34.391066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af449-77ba-4533-907c-22c132660de0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:34.391066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af449-77ba-4533-907c-22c132660de0 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:34.392455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 593/1170] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:34.397698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64226b54-b95e-40c4-86ca-ad6d608a70b1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:34.398071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64226b54-b95e-40c4-86ca-ad6d608a70b1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:34.398275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64226b54-b95e-40c4-86ca-ad6d608a70b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:34.415886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-64226b54-b95e-40c4-86ca-ad6d608a70b1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:34.417073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-64226b54-b95e-40c4-86ca-ad6d608a70b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:34.440863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:34.483010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 578/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:34.507370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af449-77ba-4533-907c-22c132660de0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:34.605127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af449-77ba-4533-907c-22c132660de0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:34.607424 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:34.638062 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22f38a-ef17-4a41-8731-38195083381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:34.638951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22f38a-ef17-4a41-8731-38195083381b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:34.639238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22f38a-ef17-4a41-8731-38195083381b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:34.639512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22f38a-ef17-4a41-8731-38195083381b None admin] PATH_INFO: `/v3/domains/771d370aa80e4ad5a983737973b95b4e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:34.650917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22f38a-ef17-4a41-8731-38195083381b None admin] RBAC: Authorizing `identity:get_domain(domain_id=771d370aa80e4ad5a983737973b95b4e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:34.652309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22f38a-ef17-4a41-8731-38195083381b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:34.653916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 594/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Jun 24 09:29:34 2022] GET /identity/v3/domains/771d370aa80e4ad5a983737973b95b4e => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:34.660453 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64226b54-b95e-40c4-86ca-ad6d608a70b1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:34.755687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64226b54-b95e-40c4-86ca-ad6d608a70b1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:34.789339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fb202-f064-47c6-bd2c-17005775ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:34.790017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fb202-f064-47c6-bd2c-17005775ad1d None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:34.790302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fb202-f064-47c6-bd2c-17005775ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:34.790615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fb202-f064-47c6-bd2c-17005775ad1d None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:34.791380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fb202-f064-47c6-bd2c-17005775ad1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:34.792819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fb202-f064-47c6-bd2c-17005775ad1d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:34.952540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 579/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:29:34 2022] POST /identity/v3/projects => generated 361 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:37.000831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1006c56-4af7-403b-8115-ebbc667d4f76 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:37.001333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1006c56-4af7-403b-8115-ebbc667d4f76 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:37.001333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1006c56-4af7-403b-8115-ebbc667d4f76 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:37.002684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 595/1174] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:37.008533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024497c-a0a1-4495-b3a5-d90a0935780a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:37.008951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024497c-a0a1-4495-b3a5-d90a0935780a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:37.009068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024497c-a0a1-4495-b3a5-d90a0935780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:37.025364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0024497c-a0a1-4495-b3a5-d90a0935780a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:37.026618 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0024497c-a0a1-4495-b3a5-d90a0935780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:37.033915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:37.092317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 580/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:37.120436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1006c56-4af7-403b-8115-ebbc667d4f76 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:37.225908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1006c56-4af7-403b-8115-ebbc667d4f76 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:37.259464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09c719-6639-4313-bfc5-bc247c3e4307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:37.260249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c719-6639-4313-bfc5-bc247c3e4307 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:37.260530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c719-6639-4313-bfc5-bc247c3e4307 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:37.260804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09c719-6639-4313-bfc5-bc247c3e4307 None admin] PATH_INFO: `/v3/domains/771d370aa80e4ad5a983737973b95b4e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:37.261952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09c719-6639-4313-bfc5-bc247c3e4307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=771d370aa80e4ad5a983737973b95b4e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:37.263386 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09c719-6639-4313-bfc5-bc247c3e4307 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:37.264966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 596/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Jun 24 09:29:37 2022] GET /identity/v3/domains/771d370aa80e4ad5a983737973b95b4e => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:37.270705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024497c-a0a1-4495-b3a5-d90a0935780a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:37.366244 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024497c-a0a1-4495-b3a5-d90a0935780a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:37.398264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447024c-06b7-4b66-8616-35ef06e9832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:37.398938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447024c-06b7-4b66-8616-35ef06e9832c None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:37.399226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447024c-06b7-4b66-8616-35ef06e9832c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:37.399508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447024c-06b7-4b66-8616-35ef06e9832c None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:37.400219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447024c-06b7-4b66-8616-35ef06e9832c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:37.401652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447024c-06b7-4b66-8616-35ef06e9832c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:37.473141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:37.478828 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 581/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:29:37 2022] POST /identity/v3/users => generated 311 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:39.524450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba478ed-8d3e-42e1-9ff9-e9036519e93a None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:39.524982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba478ed-8d3e-42e1-9ff9-e9036519e93a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:39.525073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba478ed-8d3e-42e1-9ff9-e9036519e93a None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:39.526387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 597/1178] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:39.531692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb0610-f1fe-4f61-851d-eda1a7bb59e2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:39.532163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb0610-f1fe-4f61-851d-eda1a7bb59e2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:39.532250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb0610-f1fe-4f61-851d-eda1a7bb59e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:39.549097 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a3cb0610-f1fe-4f61-851d-eda1a7bb59e2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:39.551003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a3cb0610-f1fe-4f61-851d-eda1a7bb59e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:39.616732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 582/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:39.640724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba478ed-8d3e-42e1-9ff9-e9036519e93a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:39.671892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:39.741604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba478ed-8d3e-42e1-9ff9-e9036519e93a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:39.774280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5d8c3-497b-496f-ad24-0356c22f3776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:39.775149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5d8c3-497b-496f-ad24-0356c22f3776 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:39.775388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5d8c3-497b-496f-ad24-0356c22f3776 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:39.775667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5d8c3-497b-496f-ad24-0356c22f3776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:39.786401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5d8c3-497b-496f-ad24-0356c22f3776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a6e5d8c3-497b-496f-ad24-0356c22f3776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:29:39.794105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:39.795212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:29:39.801232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 598/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:29:39.802114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb0610-f1fe-4f61-851d-eda1a7bb59e2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:39.906033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb0610-f1fe-4f61-851d-eda1a7bb59e2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:39.931661 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:39.939182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33108d-ec41-4816-85dc-382babcb2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:39.943202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33108d-ec41-4816-85dc-382babcb2af2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:39.943202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33108d-ec41-4816-85dc-382babcb2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:39.943202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33108d-ec41-4816-85dc-382babcb2af2 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:39.943202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33108d-ec41-4816-85dc-382babcb2af2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:39.943202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33108d-ec41-4816-85dc-382babcb2af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:39.943588 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33108d-ec41-4816-85dc-382babcb2af2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:39.951195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 583/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:29:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:39.956970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5d8c3-497b-496f-ad24-0356c22f3776 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:40.044270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:40.053504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5d8c3-497b-496f-ad24-0356c22f3776 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:40.086468 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c95a0-a74b-42d8-8d8d-e104d2180229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:40.087359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c95a0-a74b-42d8-8d8d-e104d2180229 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:40.087643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c95a0-a74b-42d8-8d8d-e104d2180229 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:40.087917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c95a0-a74b-42d8-8d8d-e104d2180229 None admin] PATH_INFO: `/v3/users/45432de7fabe4f2d86176bf98e3bfde6` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:40.100204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c95a0-a74b-42d8-8d8d-e104d2180229 None admin] RBAC: Authorizing `identity:get_user(user_id=45432de7fabe4f2d86176bf98e3bfde6)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:40.101634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c95a0-a74b-42d8-8d8d-e104d2180229 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:40.103291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 599/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:39 2022] GET /identity/v3/users/45432de7fabe4f2d86176bf98e3bfde6 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:40.109109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33108d-ec41-4816-85dc-382babcb2af2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:40.208880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33108d-ec41-4816-85dc-382babcb2af2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:40.243155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e57ff-20a7-4bb9-af50-e19464e5991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:40.243802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e57ff-20a7-4bb9-af50-e19464e5991d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:40.244087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e57ff-20a7-4bb9-af50-e19464e5991d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:40.244367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e57ff-20a7-4bb9-af50-e19464e5991d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:40.300373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:40.309870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e57ff-20a7-4bb9-af50-e19464e5991d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:40.311349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e57ff-20a7-4bb9-af50-e19464e5991d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:40.406109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 584/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:29:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:29:40.412559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c95a0-a74b-42d8-8d8d-e104d2180229 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:40.507957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c95a0-a74b-42d8-8d8d-e104d2180229 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:40.539940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d975c0-6814-4a3c-be0d-223b340f5cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:40.540792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d975c0-6814-4a3c-be0d-223b340f5cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:40.541079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d975c0-6814-4a3c-be0d-223b340f5cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:40.541358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d975c0-6814-4a3c-be0d-223b340f5cf5 None admin] PATH_INFO: `/v3/projects/471af7a0811b4435a090accf1e54ee5f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:40.542518 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d975c0-6814-4a3c-be0d-223b340f5cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=471af7a0811b4435a090accf1e54ee5f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:40.543972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d975c0-6814-4a3c-be0d-223b340f5cf5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:40.545650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 600/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:40 2022] GET /identity/v3/projects/471af7a0811b4435a090accf1e54ee5f => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:40.552209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e57ff-20a7-4bb9-af50-e19464e5991d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:40.639796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:40.649605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e57ff-20a7-4bb9-af50-e19464e5991d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:40.682992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fcf51-a86e-462d-a4e3-8560173d2b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:40.683631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fcf51-a86e-462d-a4e3-8560173d2b88 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:40.683913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fcf51-a86e-462d-a4e3-8560173d2b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:40.684187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fcf51-a86e-462d-a4e3-8560173d2b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:40.685001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fcf51-a86e-462d-a4e3-8560173d2b88 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=471af7a0811b4435a090accf1e54ee5f, user.id=45432de7fabe4f2d86176bf98e3bfde6) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:40.685310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fcf51-a86e-462d-a4e3-8560173d2b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:40.686735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fcf51-a86e-462d-a4e3-8560173d2b88 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:40.692125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 585/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:29:40 2022] GET /identity/v3/role_assignments?user.id=45432de7fabe4f2d86176bf98e3bfde6&scope.project.id=471af7a0811b4435a090accf1e54ee5f&role.id=9312183c32b04118985c8316f33f3830 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:42.690588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c6b7c-1bb2-4b39-881e-e4ac7aef7e5c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:42.691120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c6b7c-1bb2-4b39-881e-e4ac7aef7e5c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:42.691232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c6b7c-1bb2-4b39-881e-e4ac7aef7e5c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:42.692574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 601/1186] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:42.697817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4c99-9473-4028-9801-7f5b83647a4c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:42.698228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4c99-9473-4028-9801-7f5b83647a4c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:42.698378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a4c99-9473-4028-9801-7f5b83647a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:42.714735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c80a4c99-9473-4028-9801-7f5b83647a4c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:42.715931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c80a4c99-9473-4028-9801-7f5b83647a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:42.780814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 586/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:42.804625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c6b7c-1bb2-4b39-881e-e4ac7aef7e5c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:42.823514 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:42.903930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c6b7c-1bb2-4b39-881e-e4ac7aef7e5c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:42.936031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958e57-48e4-44a4-968c-c63119d0a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:42.936808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958e57-48e4-44a4-968c-c63119d0a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:42.937093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958e57-48e4-44a4-968c-c63119d0a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:42.937370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7958e57-48e4-44a4-968c-c63119d0a5f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:42.947598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7958e57-48e4-44a4-968c-c63119d0a5f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-b7958e57-48e4-44a4-968c-c63119d0a5f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:29:42.955213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:42.961921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:29:42.963081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 602/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:29:42.963947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a4c99-9473-4028-9801-7f5b83647a4c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:43.045543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:43.060837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a4c99-9473-4028-9801-7f5b83647a4c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:43.093829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3169e7-0f7f-4e79-b151-f49521b4e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:43.094487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3169e7-0f7f-4e79-b151-f49521b4e566 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:43.094772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3169e7-0f7f-4e79-b151-f49521b4e566 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:43.095077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3169e7-0f7f-4e79-b151-f49521b4e566 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:43.095825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3169e7-0f7f-4e79-b151-f49521b4e566 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:43.096134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3169e7-0f7f-4e79-b151-f49521b4e566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:43.098165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3169e7-0f7f-4e79-b151-f49521b4e566 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:43.106107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 587/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:43.111759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958e57-48e4-44a4-968c-c63119d0a5f6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:43.188917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:43.209605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7958e57-48e4-44a4-968c-c63119d0a5f6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:43.243046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e07942-e68a-41d4-ac09-53610c61992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:43.243900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e07942-e68a-41d4-ac09-53610c61992a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:43.244189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e07942-e68a-41d4-ac09-53610c61992a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:43.244462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e07942-e68a-41d4-ac09-53610c61992a None admin] PATH_INFO: `/v3/users/45432de7fabe4f2d86176bf98e3bfde6` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:43.245623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e07942-e68a-41d4-ac09-53610c61992a None admin] RBAC: Authorizing `identity:get_user(user_id=45432de7fabe4f2d86176bf98e3bfde6)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:43.247072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e07942-e68a-41d4-ac09-53610c61992a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:43.248675 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 603/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:43 2022] GET /identity/v3/users/45432de7fabe4f2d86176bf98e3bfde6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:43.254931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3169e7-0f7f-4e79-b151-f49521b4e566 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:43.351467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3169e7-0f7f-4e79-b151-f49521b4e566 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:43.384025 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26276e5c-95fa-4a22-bf5f-72c31fa70e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:43.384857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276e5c-95fa-4a22-bf5f-72c31fa70e42 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:43.385135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276e5c-95fa-4a22-bf5f-72c31fa70e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:43.385407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26276e5c-95fa-4a22-bf5f-72c31fa70e42 None admin] PATH_INFO: `/v3/projects/471af7a0811b4435a090accf1e54ee5f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:43.386561 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26276e5c-95fa-4a22-bf5f-72c31fa70e42 None admin] RBAC: Authorizing `identity:get_project(project_id=471af7a0811b4435a090accf1e54ee5f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:43.388011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26276e5c-95fa-4a22-bf5f-72c31fa70e42 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:43.389652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 588/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:43 2022] GET /identity/v3/projects/471af7a0811b4435a090accf1e54ee5f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:43.395914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e07942-e68a-41d4-ac09-53610c61992a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:43.491092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e07942-e68a-41d4-ac09-53610c61992a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:43.525091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01178471-8172-47d1-85a6-d809e740b705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:43.525964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01178471-8172-47d1-85a6-d809e740b705 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:43.526246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01178471-8172-47d1-85a6-d809e740b705 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:43.526521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01178471-8172-47d1-85a6-d809e740b705 None admin] PATH_INFO: `/v3/projects/471af7a0811b4435a090accf1e54ee5f/users/45432de7fabe4f2d86176bf98e3bfde6/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:43.528486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01178471-8172-47d1-85a6-d809e740b705 None admin] RBAC: Authorizing `identity:create_grant(project_id=471af7a0811b4435a090accf1e54ee5f, user_id=45432de7fabe4f2d86176bf98e3bfde6, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:43.529903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01178471-8172-47d1-85a6-d809e740b705 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:43.607506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 604/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:29:43 2022] PUT /identity/v3/projects/471af7a0811b4435a090accf1e54ee5f/users/45432de7fabe4f2d86176bf98e3bfde6/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:45.619837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f106-0069-4594-846e-53c3670117e6 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:45.620250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f106-0069-4594-846e-53c3670117e6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:45.620405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d37f106-0069-4594-846e-53c3670117e6 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:45.621782 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 589/1193] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:29:45.627005 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53c608-3a37-4a60-86ea-85a15f8e9268 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:45.627384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53c608-3a37-4a60-86ea-85a15f8e9268 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:45.627572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53c608-3a37-4a60-86ea-85a15f8e9268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:45.638678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:45.644430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9c53c608-3a37-4a60-86ea-85a15f8e9268 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:45.645610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9c53c608-3a37-4a60-86ea-85a15f8e9268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:45.710419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 605/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:29:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:29:45.734307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f106-0069-4594-846e-53c3670117e6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:45.750926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:45.834629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d37f106-0069-4594-846e-53c3670117e6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:45.868201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7dde2-749c-48de-b1f4-9fdf60dfae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:45.868924 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7dde2-749c-48de-b1f4-9fdf60dfae67 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:45.869210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7dde2-749c-48de-b1f4-9fdf60dfae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:45.869492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7dde2-749c-48de-b1f4-9fdf60dfae67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:45.879445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7dde2-749c-48de-b1f4-9fdf60dfae67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-cac7dde2-749c-48de-b1f4-9fdf60dfae67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:29:45.887156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:29:45.888221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:29:45.889246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 590/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:29:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:29:45.894791 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53c608-3a37-4a60-86ea-85a15f8e9268 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:45.989203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53c608-3a37-4a60-86ea-85a15f8e9268 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:46.022401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4da281-c18b-45f2-8167-178c324f853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:46.023079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4da281-c18b-45f2-8167-178c324f853f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:46.023364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4da281-c18b-45f2-8167-178c324f853f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:46.023638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4da281-c18b-45f2-8167-178c324f853f None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:46.024374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4da281-c18b-45f2-8167-178c324f853f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:46.024680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4da281-c18b-45f2-8167-178c324f853f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:46.026044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4da281-c18b-45f2-8167-178c324f853f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:46.028141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:46.034110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 606/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:29:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:46.040904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7dde2-749c-48de-b1f4-9fdf60dfae67 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:46.113284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:46.136764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7dde2-749c-48de-b1f4-9fdf60dfae67 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:46.169915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aadde-b98d-4508-a36c-3ad278c9e097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:46.170762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aadde-b98d-4508-a36c-3ad278c9e097 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:46.171067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aadde-b98d-4508-a36c-3ad278c9e097 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:46.171340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aadde-b98d-4508-a36c-3ad278c9e097 None admin] PATH_INFO: `/v3/users/45432de7fabe4f2d86176bf98e3bfde6` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:46.172502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972aadde-b98d-4508-a36c-3ad278c9e097 None admin] RBAC: Authorizing `identity:get_user(user_id=45432de7fabe4f2d86176bf98e3bfde6)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:46.173925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972aadde-b98d-4508-a36c-3ad278c9e097 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:46.175702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 591/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 09:29:46 2022] GET /identity/v3/users/45432de7fabe4f2d86176bf98e3bfde6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:46.181286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4da281-c18b-45f2-8167-178c324f853f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:46.277936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4da281-c18b-45f2-8167-178c324f853f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:46.311079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36352e2f-c3ee-46e2-b771-b9c8fe8dfcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:46.311711 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36352e2f-c3ee-46e2-b771-b9c8fe8dfcbf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:46.311997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36352e2f-c3ee-46e2-b771-b9c8fe8dfcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:46.312273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36352e2f-c3ee-46e2-b771-b9c8fe8dfcbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:46.376183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:46.380250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36352e2f-c3ee-46e2-b771-b9c8fe8dfcbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:46.381684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36352e2f-c3ee-46e2-b771-b9c8fe8dfcbf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:46.475581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 607/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:29:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:29:46.481324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aadde-b98d-4508-a36c-3ad278c9e097 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:46.580199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aadde-b98d-4508-a36c-3ad278c9e097 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:46.614575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0a377-f0bc-432c-9d5e-8d8f828244fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:46.615455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0a377-f0bc-432c-9d5e-8d8f828244fc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:46.615737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0a377-f0bc-432c-9d5e-8d8f828244fc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:46.616011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0a377-f0bc-432c-9d5e-8d8f828244fc None admin] PATH_INFO: `/v3/projects/471af7a0811b4435a090accf1e54ee5f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:46.617159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0a377-f0bc-432c-9d5e-8d8f828244fc None admin] RBAC: Authorizing `identity:get_project(project_id=471af7a0811b4435a090accf1e54ee5f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:46.618579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0a377-f0bc-432c-9d5e-8d8f828244fc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:46.620270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 592/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 09:29:46 2022] GET /identity/v3/projects/471af7a0811b4435a090accf1e54ee5f => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:46.626402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36352e2f-c3ee-46e2-b771-b9c8fe8dfcbf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:46.718813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:46.722486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36352e2f-c3ee-46e2-b771-b9c8fe8dfcbf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:46.757959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb5c5-34b8-4792-a3fc-c1dffdaa8042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:46.758540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb5c5-34b8-4792-a3fc-c1dffdaa8042 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:46.758824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb5c5-34b8-4792-a3fc-c1dffdaa8042 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:46.759133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb5c5-34b8-4792-a3fc-c1dffdaa8042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:46.759955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb5c5-34b8-4792-a3fc-c1dffdaa8042 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=471af7a0811b4435a090accf1e54ee5f, user.id=45432de7fabe4f2d86176bf98e3bfde6) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:46.760265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb5c5-34b8-4792-a3fc-c1dffdaa8042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:46.761686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb5c5-34b8-4792-a3fc-c1dffdaa8042 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:46.767421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 608/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:29:46 2022] GET /identity/v3/role_assignments?user.id=45432de7fabe4f2d86176bf98e3bfde6&scope.project.id=471af7a0811b4435a090accf1e54ee5f&role.id=9312183c32b04118985c8316f33f3830 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:56.609730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:56.764850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=19 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:00.419367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650769f-7902-4878-bf01-5c64a703fbd5 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:00.419953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650769f-7902-4878-bf01-5c64a703fbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:00.419953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650769f-7902-4878-bf01-5c64a703fbd5 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:00.421307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 593/1201] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:00.426592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71bf0c-f71c-46a0-850e-f1ab02031cc3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:00.430290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71bf0c-f71c-46a0-850e-f1ab02031cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:00.430290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed71bf0c-f71c-46a0-850e-f1ab02031cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:00.444279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ed71bf0c-f71c-46a0-850e-f1ab02031cc3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:00.445450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ed71bf0c-f71c-46a0-850e-f1ab02031cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:00.511905 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 609/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:00.537632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650769f-7902-4878-bf01-5c64a703fbd5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:00.639120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9650769f-7902-4878-bf01-5c64a703fbd5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:00.673068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7603c53-cb3c-4f3e-9eb4-4393cd77713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:00.673791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7603c53-cb3c-4f3e-9eb4-4393cd77713b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:00.674076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7603c53-cb3c-4f3e-9eb4-4393cd77713b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:00.674355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7603c53-cb3c-4f3e-9eb4-4393cd77713b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:00.684553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7603c53-cb3c-4f3e-9eb4-4393cd77713b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:00.685988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7603c53-cb3c-4f3e-9eb4-4393cd77713b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c7603c53-cb3c-4f3e-9eb4-4393cd77713b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:00.703884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:00.705022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:00.706148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:00.706148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:00.706148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:00.706148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:00.706148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 594/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:31:00.711867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71bf0c-f71c-46a0-850e-f1ab02031cc3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:00.808611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed71bf0c-f71c-46a0-850e-f1ab02031cc3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:00.836963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:00.842622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134da8b-ddfd-43d1-adca-45511e64fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:00.843319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134da8b-ddfd-43d1-adca-45511e64fdcd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:00.843605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134da8b-ddfd-43d1-adca-45511e64fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:00.843882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134da8b-ddfd-43d1-adca-45511e64fdcd None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:00.844595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134da8b-ddfd-43d1-adca-45511e64fdcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:00.845009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134da8b-ddfd-43d1-adca-45511e64fdcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:00.846372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134da8b-ddfd-43d1-adca-45511e64fdcd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:00.857692 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 610/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:00.863358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7603c53-cb3c-4f3e-9eb4-4393cd77713b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:00.918435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:00.966503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7603c53-cb3c-4f3e-9eb4-4393cd77713b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:01.000547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a09a7-7db0-4f85-9a6b-8a7120a742d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:01.001215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a09a7-7db0-4f85-9a6b-8a7120a742d3 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:01.001503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a09a7-7db0-4f85-9a6b-8a7120a742d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:01.001785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a09a7-7db0-4f85-9a6b-8a7120a742d3 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:01.002484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a09a7-7db0-4f85-9a6b-8a7120a742d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:01.003980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a09a7-7db0-4f85-9a6b-8a7120a742d3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:01.113039 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 595/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 09:31:00 2022] POST /identity/v3/users => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:31:03.183607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a3476-9d04-4a9a-805b-7a18a52a6d17 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:03.184155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a3476-9d04-4a9a-805b-7a18a52a6d17 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:03.184155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a3476-9d04-4a9a-805b-7a18a52a6d17 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:03.185522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 611/1206] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:03.191014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8757b-bff3-4324-b11c-de62a50161e8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:03.191430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8757b-bff3-4324-b11c-de62a50161e8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:03.191578 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8757b-bff3-4324-b11c-de62a50161e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:03.208977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-39b8757b-bff3-4324-b11c-de62a50161e8 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:03.210216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-39b8757b-bff3-4324-b11c-de62a50161e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:03.276530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 596/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:03.300548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a3476-9d04-4a9a-805b-7a18a52a6d17 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:03.402167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a3476-9d04-4a9a-805b-7a18a52a6d17 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:03.435221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1691e-4eb5-44c1-b5f0-f7e2241b8dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:03.435923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1691e-4eb5-44c1-b5f0-f7e2241b8dcc None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:03.436208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1691e-4eb5-44c1-b5f0-f7e2241b8dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:03.436486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f1691e-4eb5-44c1-b5f0-f7e2241b8dcc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:03.447830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f1691e-4eb5-44c1-b5f0-f7e2241b8dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-99f1691e-4eb5-44c1-b5f0-f7e2241b8dcc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:31:03.455756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:03.456824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:03.457681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 612/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:31:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:03.463176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8757b-bff3-4324-b11c-de62a50161e8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:03.502022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:03.560600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8757b-bff3-4324-b11c-de62a50161e8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:03.594986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b8cab-94d3-47b0-8680-84db218a625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:03.595675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8cab-94d3-47b0-8680-84db218a625c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:03.595963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8cab-94d3-47b0-8680-84db218a625c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:03.596246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b8cab-94d3-47b0-8680-84db218a625c None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:03.596995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b8cab-94d3-47b0-8680-84db218a625c None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:03.597308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b8cab-94d3-47b0-8680-84db218a625c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:03.598684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8b8cab-94d3-47b0-8680-84db218a625c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:03.607531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 597/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:31:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:03.613269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1691e-4eb5-44c1-b5f0-f7e2241b8dcc None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:03.663141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:03.711119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f1691e-4eb5-44c1-b5f0-f7e2241b8dcc None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:03.745365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562311d-88d9-45d2-bb5e-67d2c36f4a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:03.746154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562311d-88d9-45d2-bb5e-67d2c36f4a56 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:03.746473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562311d-88d9-45d2-bb5e-67d2c36f4a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:03.746774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562311d-88d9-45d2-bb5e-67d2c36f4a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:03.756677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562311d-88d9-45d2-bb5e-67d2c36f4a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:03.760740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562311d-88d9-45d2-bb5e-67d2c36f4a56 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-3562311d-88d9-45d2-bb5e-67d2c36f4a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:03.776488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:03.777577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:03.778862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:03.778862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:03.778862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:03.778862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:03.778862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 613/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:03.783573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b8cab-94d3-47b0-8680-84db218a625c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:03.882318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:03.885178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b8cab-94d3-47b0-8680-84db218a625c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:03.918357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5426b0-7b5c-4123-bdaa-8169e0ec2d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:03.919028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5426b0-7b5c-4123-bdaa-8169e0ec2d54 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:03.919310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5426b0-7b5c-4123-bdaa-8169e0ec2d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:03.919585 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5426b0-7b5c-4123-bdaa-8169e0ec2d54 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:03.920294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5426b0-7b5c-4123-bdaa-8169e0ec2d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:03.920599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5426b0-7b5c-4123-bdaa-8169e0ec2d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:03.921956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5426b0-7b5c-4123-bdaa-8169e0ec2d54 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:03.933783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 598/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:03.939408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562311d-88d9-45d2-bb5e-67d2c36f4a56 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:04.038641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562311d-88d9-45d2-bb5e-67d2c36f4a56 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:04.040243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:04.072146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4369e-9823-4c46-b288-45618830d740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:04.072941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4369e-9823-4c46-b288-45618830d740 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:04.073224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4369e-9823-4c46-b288-45618830d740 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:04.073498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4369e-9823-4c46-b288-45618830d740 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:04.080184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4369e-9823-4c46-b288-45618830d740 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:04.081605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4369e-9823-4c46-b288-45618830d740 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c9b4369e-9823-4c46-b288-45618830d740 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:31:04.103473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:04.104455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:04.105510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 614/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:04.115831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5426b0-7b5c-4123-bdaa-8169e0ec2d54 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:04.218514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5426b0-7b5c-4123-bdaa-8169e0ec2d54 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:04.257967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a7bb-0081-408a-938d-ecbae18fbcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:04.258792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a7bb-0081-408a-938d-ecbae18fbcaf None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:04.259216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a7bb-0081-408a-938d-ecbae18fbcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:04.259590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8a7bb-0081-408a-938d-ecbae18fbcaf None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:04.260546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8a7bb-0081-408a-938d-ecbae18fbcaf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:04.260951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8a7bb-0081-408a-938d-ecbae18fbcaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:04.262480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8a7bb-0081-408a-938d-ecbae18fbcaf None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:04.281359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 599/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 09:31:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:04.288013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4369e-9823-4c46-b288-45618830d740 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:04.393106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4369e-9823-4c46-b288-45618830d740 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:04.428799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926467e-2355-4982-a0e8-68ceb858d760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:04.429452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926467e-2355-4982-a0e8-68ceb858d760 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:04.429735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926467e-2355-4982-a0e8-68ceb858d760 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:04.430008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926467e-2355-4982-a0e8-68ceb858d760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:04.460833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:04.500806 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926467e-2355-4982-a0e8-68ceb858d760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:04.502322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926467e-2355-4982-a0e8-68ceb858d760 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:04.612038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 615/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:31:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:31:04.618332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a7bb-0081-408a-938d-ecbae18fbcaf None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:04.650422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:04.739017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8a7bb-0081-408a-938d-ecbae18fbcaf None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:04.779523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab5b7c-37fa-4492-84ec-a3e59043bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:04.780322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab5b7c-37fa-4492-84ec-a3e59043bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:04.780609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab5b7c-37fa-4492-84ec-a3e59043bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:04.780888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab5b7c-37fa-4492-84ec-a3e59043bfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:04.791477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab5b7c-37fa-4492-84ec-a3e59043bfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:04.792938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab5b7c-37fa-4492-84ec-a3e59043bfd2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-19ab5b7c-37fa-4492-84ec-a3e59043bfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:04.812964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:04.814103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:04.815230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:04.815230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:04.815230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:04.815230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:04.815230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 600/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:04.823846 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926467e-2355-4982-a0e8-68ceb858d760 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:04.889016 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:04.929485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926467e-2355-4982-a0e8-68ceb858d760 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:04.963598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef612626-b2c9-4151-b893-659c70d0c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:04.964270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef612626-b2c9-4151-b893-659c70d0c382 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:04.964558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef612626-b2c9-4151-b893-659c70d0c382 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:04.964839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef612626-b2c9-4151-b893-659c70d0c382 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:04.965564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef612626-b2c9-4151-b893-659c70d0c382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:04.965874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef612626-b2c9-4151-b893-659c70d0c382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:04.967281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef612626-b2c9-4151-b893-659c70d0c382 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:04.978648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 616/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:04.984293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab5b7c-37fa-4492-84ec-a3e59043bfd2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:05.059967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:05.089720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab5b7c-37fa-4492-84ec-a3e59043bfd2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:05.125024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99329f2-9917-4096-b374-d18a32a6d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:05.125821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99329f2-9917-4096-b374-d18a32a6d1cd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:05.126108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99329f2-9917-4096-b374-d18a32a6d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:05.126388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99329f2-9917-4096-b374-d18a32a6d1cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:05.133044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99329f2-9917-4096-b374-d18a32a6d1cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:05.134493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99329f2-9917-4096-b374-d18a32a6d1cd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c99329f2-9917-4096-b374-d18a32a6d1cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:31:05.148062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:05.149154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:05.150380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:31:05.150380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:31:05.150380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:31:05.150380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:31:05.150380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:31:05.150380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:31:05.150380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:05.150380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:05.150380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 601/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:05.155142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef612626-b2c9-4151-b893-659c70d0c382 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:05.256287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef612626-b2c9-4151-b893-659c70d0c382 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:05.278411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:05.290786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa67d05-71cd-4948-afc3-e25d5e8137a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:05.291487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67d05-71cd-4948-afc3-e25d5e8137a9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:05.291771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67d05-71cd-4948-afc3-e25d5e8137a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:05.292046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67d05-71cd-4948-afc3-e25d5e8137a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:05.292826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa67d05-71cd-4948-afc3-e25d5e8137a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:05.293135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa67d05-71cd-4948-afc3-e25d5e8137a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:05.294562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa67d05-71cd-4948-afc3-e25d5e8137a9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:05.306906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 617/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:31:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:05.313239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99329f2-9917-4096-b374-d18a32a6d1cd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:05.413529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99329f2-9917-4096-b374-d18a32a6d1cd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:05.441218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:05.447159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b8806-f5c3-4eaa-bb12-3a34bf6fda49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:05.449767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b8806-f5c3-4eaa-bb12-3a34bf6fda49 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:05.449767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b8806-f5c3-4eaa-bb12-3a34bf6fda49 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:05.449767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b8806-f5c3-4eaa-bb12-3a34bf6fda49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:05.449767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b8806-f5c3-4eaa-bb12-3a34bf6fda49 None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=87fd5580ed264a08a3ad31850e0a53a4) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:05.449767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b8806-f5c3-4eaa-bb12-3a34bf6fda49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:05.450887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b8806-f5c3-4eaa-bb12-3a34bf6fda49 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:05.456256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 602/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:31:05 2022] GET /identity/v3/role_assignments?user.id=87fd5580ed264a08a3ad31850e0a53a4&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:07.460476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a204a60-1922-4fe8-92a3-71de7cd3e668 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:07.461001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a204a60-1922-4fe8-92a3-71de7cd3e668 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:07.461127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a204a60-1922-4fe8-92a3-71de7cd3e668 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:07.462429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 618/1220] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:07.467545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23f2d3-fcb8-4c78-85f9-a9af8ad3edaa None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:07.469181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23f2d3-fcb8-4c78-85f9-a9af8ad3edaa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:07.469181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23f2d3-fcb8-4c78-85f9-a9af8ad3edaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:07.484618 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7c23f2d3-fcb8-4c78-85f9-a9af8ad3edaa None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:07.485808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7c23f2d3-fcb8-4c78-85f9-a9af8ad3edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:07.551683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 603/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:07.576057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a204a60-1922-4fe8-92a3-71de7cd3e668 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:07.677061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a204a60-1922-4fe8-92a3-71de7cd3e668 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:07.712011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fb8d2-5d83-4b5b-9488-fd4a7d49d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:07.712783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fb8d2-5d83-4b5b-9488-fd4a7d49d8ce None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:07.713021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fb8d2-5d83-4b5b-9488-fd4a7d49d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:07.713297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fb8d2-5d83-4b5b-9488-fd4a7d49d8ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:07.723233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fb8d2-5d83-4b5b-9488-fd4a7d49d8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-cc4fb8d2-5d83-4b5b-9488-fd4a7d49d8ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:31:07.731153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:07.732274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:07.733366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 619/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:07.738464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23f2d3-fcb8-4c78-85f9-a9af8ad3edaa None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:07.838540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23f2d3-fcb8-4c78-85f9-a9af8ad3edaa None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:07.861345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:07.872617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd0bc-1456-4c11-86b5-f8b4bb5b7bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:07.873278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd0bc-1456-4c11-86b5-f8b4bb5b7bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:07.873563 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd0bc-1456-4c11-86b5-f8b4bb5b7bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:07.873841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd0bc-1456-4c11-86b5-f8b4bb5b7bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:07.874700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdd0bc-1456-4c11-86b5-f8b4bb5b7bc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:07.875034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdd0bc-1456-4c11-86b5-f8b4bb5b7bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:07.876409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdd0bc-1456-4c11-86b5-f8b4bb5b7bc8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:07.884826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 604/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:31:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:07.890676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fb8d2-5d83-4b5b-9488-fd4a7d49d8ce None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:07.933720 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:07.988866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fb8d2-5d83-4b5b-9488-fd4a7d49d8ce None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:08.022349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4d399-4121-4d2d-a22c-8aa6cdfa7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:08.025779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4d399-4121-4d2d-a22c-8aa6cdfa7772 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:08.025779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4d399-4121-4d2d-a22c-8aa6cdfa7772 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:08.025779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4d399-4121-4d2d-a22c-8aa6cdfa7772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:08.033891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4d399-4121-4d2d-a22c-8aa6cdfa7772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:08.035380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4d399-4121-4d2d-a22c-8aa6cdfa7772 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-9cf4d399-4121-4d2d-a22c-8aa6cdfa7772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:08.053466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:08.057828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:08.058725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:08.058725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:08.058725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:08.058725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:08.058725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 620/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:08.060553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd0bc-1456-4c11-86b5-f8b4bb5b7bc8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:08.161747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd0bc-1456-4c11-86b5-f8b4bb5b7bc8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:08.194497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca5fd2-005d-4c5b-bfca-7667f2a6b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:08.197868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca5fd2-005d-4c5b-bfca-7667f2a6b392 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:08.197868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca5fd2-005d-4c5b-bfca-7667f2a6b392 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:08.197868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca5fd2-005d-4c5b-bfca-7667f2a6b392 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:08.197868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca5fd2-005d-4c5b-bfca-7667f2a6b392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:08.197868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca5fd2-005d-4c5b-bfca-7667f2a6b392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:08.198459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca5fd2-005d-4c5b-bfca-7667f2a6b392 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:08.210157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 605/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:08.216121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4d399-4121-4d2d-a22c-8aa6cdfa7772 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:08.308758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:08.315115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4d399-4121-4d2d-a22c-8aa6cdfa7772 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:08.350736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620179-70fb-470f-b6ad-37ac5bf8dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:08.351556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620179-70fb-470f-b6ad-37ac5bf8dad0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:08.351836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620179-70fb-470f-b6ad-37ac5bf8dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:08.352109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d620179-70fb-470f-b6ad-37ac5bf8dad0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:08.359285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620179-70fb-470f-b6ad-37ac5bf8dad0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:08.360713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d620179-70fb-470f-b6ad-37ac5bf8dad0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-5d620179-70fb-470f-b6ad-37ac5bf8dad0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:31:08.375271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:08.376381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:08.377728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 621/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:08.383216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca5fd2-005d-4c5b-bfca-7667f2a6b392 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:08.429888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:08.481760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca5fd2-005d-4c5b-bfca-7667f2a6b392 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:08.513831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74d617-cee3-4c1a-9a1b-137151c6e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:08.514489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74d617-cee3-4c1a-9a1b-137151c6e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:08.514771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74d617-cee3-4c1a-9a1b-137151c6e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:08.515073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74d617-cee3-4c1a-9a1b-137151c6e1a0 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:08.515965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74d617-cee3-4c1a-9a1b-137151c6e1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:08.516639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74d617-cee3-4c1a-9a1b-137151c6e1a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:08.518792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74d617-cee3-4c1a-9a1b-137151c6e1a0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:08.537813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 606/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 09:31:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:08.543554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620179-70fb-470f-b6ad-37ac5bf8dad0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:08.643755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d620179-70fb-470f-b6ad-37ac5bf8dad0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:08.679467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c86d-a9df-41fa-ab91-571f04217c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:08.680253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c86d-a9df-41fa-ab91-571f04217c35 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:08.680543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c86d-a9df-41fa-ab91-571f04217c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:08.680823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51c86d-a9df-41fa-ab91-571f04217c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:08.691983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51c86d-a9df-41fa-ab91-571f04217c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:08.693474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51c86d-a9df-41fa-ab91-571f04217c35 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-0e51c86d-a9df-41fa-ab91-571f04217c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:08.711395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:08.712458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:08.713755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:08.713755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:08.713755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:08.713755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:08.713755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 622/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:08.718403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74d617-cee3-4c1a-9a1b-137151c6e1a0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:08.816803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74d617-cee3-4c1a-9a1b-137151c6e1a0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:08.819783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:08.851032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304f7f-cded-405e-b716-765597c86efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:08.851631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304f7f-cded-405e-b716-765597c86efa None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:08.851917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304f7f-cded-405e-b716-765597c86efa None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:08.852194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304f7f-cded-405e-b716-765597c86efa None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:08.852962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304f7f-cded-405e-b716-765597c86efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:08.853270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304f7f-cded-405e-b716-765597c86efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:08.854639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304f7f-cded-405e-b716-765597c86efa None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:08.865446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 607/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:08.871508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c86d-a9df-41fa-ab91-571f04217c35 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:08.881910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:08.971693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51c86d-a9df-41fa-ab91-571f04217c35 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:09.004704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70013795-73ea-459c-8bff-6f86308d4c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:09.006491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70013795-73ea-459c-8bff-6f86308d4c88 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:09.007350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70013795-73ea-459c-8bff-6f86308d4c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:09.007659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70013795-73ea-459c-8bff-6f86308d4c88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:09.014256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70013795-73ea-459c-8bff-6f86308d4c88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:09.015718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70013795-73ea-459c-8bff-6f86308d4c88 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-70013795-73ea-459c-8bff-6f86308d4c88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:31:09.030602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:09.031710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:09.032978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:31:09.032978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:31:09.032978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:31:09.032978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:31:09.032978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:31:09.032978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:31:09.032978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:09.032978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:09.032978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 623/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:09.037724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304f7f-cded-405e-b716-765597c86efa None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:09.138414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304f7f-cded-405e-b716-765597c86efa None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:09.171322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9e9c2-9c81-4c05-9927-ec5535a5b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:09.171975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e9c2-9c81-4c05-9927-ec5535a5b1bb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:09.172364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e9c2-9c81-4c05-9927-ec5535a5b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:09.172639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9e9c2-9c81-4c05-9927-ec5535a5b1bb None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:09.173420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9e9c2-9c81-4c05-9927-ec5535a5b1bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:09.173730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9e9c2-9c81-4c05-9927-ec5535a5b1bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:09.175199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9e9c2-9c81-4c05-9927-ec5535a5b1bb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:09.187436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 608/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:09.194219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70013795-73ea-459c-8bff-6f86308d4c88 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:09.259364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:09.292999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70013795-73ea-459c-8bff-6f86308d4c88 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:09.326444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7188e96-50ca-4c91-b4ed-b14251c06b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:09.327466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188e96-50ca-4c91-b4ed-b14251c06b78 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:09.327774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188e96-50ca-4c91-b4ed-b14251c06b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:09.328055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7188e96-50ca-4c91-b4ed-b14251c06b78 None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/87fd5580ed264a08a3ad31850e0a53a4/roles/ea353bbe72d949cb9417cea310e8d194` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:09.341838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188e96-50ca-4c91-b4ed-b14251c06b78 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=87fd5580ed264a08a3ad31850e0a53a4, role_id=ea353bbe72d949cb9417cea310e8d194)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:09.343318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7188e96-50ca-4c91-b4ed-b14251c06b78 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:09.441865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 624/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:31:09 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/87fd5580ed264a08a3ad31850e0a53a4/roles/ea353bbe72d949cb9417cea310e8d194 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:31:11.459427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572808d9-cd79-41c0-af90-25ea369a2be6 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:11.459953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572808d9-cd79-41c0-af90-25ea369a2be6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:11.460136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572808d9-cd79-41c0-af90-25ea369a2be6 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:11.461525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 609/1233] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:11.466800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c3294-ee0e-4111-ba97-b259ceefeb96 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:11.467272 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c3294-ee0e-4111-ba97-b259ceefeb96 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:11.467379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c3294-ee0e-4111-ba97-b259ceefeb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:11.483812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-675c3294-ee0e-4111-ba97-b259ceefeb96 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:11.484975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-675c3294-ee0e-4111-ba97-b259ceefeb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:11.549430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 625/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:11.573277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572808d9-cd79-41c0-af90-25ea369a2be6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:11.600747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:11.677232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572808d9-cd79-41c0-af90-25ea369a2be6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:11.711767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6959be9-2f42-4151-821b-9e6fd4e423fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:11.712496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959be9-2f42-4151-821b-9e6fd4e423fc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:11.712784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959be9-2f42-4151-821b-9e6fd4e423fc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:11.713062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6959be9-2f42-4151-821b-9e6fd4e423fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:11.723181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6959be9-2f42-4151-821b-9e6fd4e423fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d6959be9-2f42-4151-821b-9e6fd4e423fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:31:11.731909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:11.735358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:11.736402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 610/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 09:31:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:11.739217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c3294-ee0e-4111-ba97-b259ceefeb96 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:11.784797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:11.837616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c3294-ee0e-4111-ba97-b259ceefeb96 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:11.870152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95901fc2-2e5a-441a-99b2-0c6f967f344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:11.870819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95901fc2-2e5a-441a-99b2-0c6f967f344a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:11.871142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95901fc2-2e5a-441a-99b2-0c6f967f344a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:11.871423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95901fc2-2e5a-441a-99b2-0c6f967f344a None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:11.872172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95901fc2-2e5a-441a-99b2-0c6f967f344a None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:11.872482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95901fc2-2e5a-441a-99b2-0c6f967f344a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:11.873883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95901fc2-2e5a-441a-99b2-0c6f967f344a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:11.882801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 626/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 09:31:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:11.888465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6959be9-2f42-4151-821b-9e6fd4e423fc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:11.972975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:11.988202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6959be9-2f42-4151-821b-9e6fd4e423fc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:12.021794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cb007-dd75-492f-815b-46ce09b6e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:12.023095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cb007-dd75-492f-815b-46ce09b6e086 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:12.023431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cb007-dd75-492f-815b-46ce09b6e086 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:12.023708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cb007-dd75-492f-815b-46ce09b6e086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:12.034008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cb007-dd75-492f-815b-46ce09b6e086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:12.035492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cb007-dd75-492f-815b-46ce09b6e086 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-895cb007-dd75-492f-815b-46ce09b6e086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:12.052289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:12.053386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:12.054358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:12.054358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:12.054358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:12.054358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:12.054358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 611/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:12.059351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95901fc2-2e5a-441a-99b2-0c6f967f344a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:12.157871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95901fc2-2e5a-441a-99b2-0c6f967f344a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:12.186530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:12.194165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04a4f2-92ea-421a-a10f-7598e5dcfeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:12.194684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a4f2-92ea-421a-a10f-7598e5dcfeec None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:12.195039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a4f2-92ea-421a-a10f-7598e5dcfeec None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:12.195323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a4f2-92ea-421a-a10f-7598e5dcfeec None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:12.196043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04a4f2-92ea-421a-a10f-7598e5dcfeec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:12.196367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04a4f2-92ea-421a-a10f-7598e5dcfeec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:12.197746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04a4f2-92ea-421a-a10f-7598e5dcfeec None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:12.208800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 627/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:12.214739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cb007-dd75-492f-815b-46ce09b6e086 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:12.314517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cb007-dd75-492f-815b-46ce09b6e086 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:12.347504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ea72-8e4a-48e1-a924-dcc38d47058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:12.348296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ea72-8e4a-48e1-a924-dcc38d47058d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:12.349852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ea72-8e4a-48e1-a924-dcc38d47058d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:12.349852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ea72-8e4a-48e1-a924-dcc38d47058d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:12.351693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:12.356632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ea72-8e4a-48e1-a924-dcc38d47058d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:12.358144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672ea72-8e4a-48e1-a924-dcc38d47058d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3672ea72-8e4a-48e1-a924-dcc38d47058d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:31:12.373196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:12.374339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:12.375545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 612/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:31:12.380116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04a4f2-92ea-421a-a10f-7598e5dcfeec None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:12.478274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04a4f2-92ea-421a-a10f-7598e5dcfeec None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:12.511979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07f2ed-644e-47cb-8e2e-c5f516ffd627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:12.512634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07f2ed-644e-47cb-8e2e-c5f516ffd627 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:12.512915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07f2ed-644e-47cb-8e2e-c5f516ffd627 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:12.513187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da07f2ed-644e-47cb-8e2e-c5f516ffd627 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:12.514007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07f2ed-644e-47cb-8e2e-c5f516ffd627 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:12.514311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07f2ed-644e-47cb-8e2e-c5f516ffd627 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:12.515753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da07f2ed-644e-47cb-8e2e-c5f516ffd627 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:12.532972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 628/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 09:31:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:12.539667 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ea72-8e4a-48e1-a924-dcc38d47058d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:12.640680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ea72-8e4a-48e1-a924-dcc38d47058d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:12.673489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7100c2f-35ca-45d3-9e31-8c03c69fefa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:12.674136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100c2f-35ca-45d3-9e31-8c03c69fefa4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:12.674421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100c2f-35ca-45d3-9e31-8c03c69fefa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:12.674700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7100c2f-35ca-45d3-9e31-8c03c69fefa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:12.740795 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:12.747643 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7100c2f-35ca-45d3-9e31-8c03c69fefa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:12.749165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7100c2f-35ca-45d3-9e31-8c03c69fefa4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:12.845538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 613/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:31:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:31:12.851651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07f2ed-644e-47cb-8e2e-c5f516ffd627 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:12.879448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:12.950155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da07f2ed-644e-47cb-8e2e-c5f516ffd627 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:12.985429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a10e-f01e-494e-a3b3-759733e8e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:12.986214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a10e-f01e-494e-a3b3-759733e8e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:12.986523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a10e-f01e-494e-a3b3-759733e8e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:12.986805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a10e-f01e-494e-a3b3-759733e8e3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:12.996898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3a10e-f01e-494e-a3b3-759733e8e3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:12.998448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3a10e-f01e-494e-a3b3-759733e8e3a3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-b0d3a10e-f01e-494e-a3b3-759733e8e3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:13.016502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:13.017603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:13.019643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:13.019643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:13.019643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:13.019643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:13.019643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 629/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:13.024205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7100c2f-35ca-45d3-9e31-8c03c69fefa4 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:13.124432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:13.130234 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7100c2f-35ca-45d3-9e31-8c03c69fefa4 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:13.166865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c65fc-b526-49c2-954c-e16adad9ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:13.167544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c65fc-b526-49c2-954c-e16adad9ca81 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:13.167828 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c65fc-b526-49c2-954c-e16adad9ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:13.168108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c65fc-b526-49c2-954c-e16adad9ca81 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:13.168838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c65fc-b526-49c2-954c-e16adad9ca81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:13.169141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c65fc-b526-49c2-954c-e16adad9ca81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:13.170525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c65fc-b526-49c2-954c-e16adad9ca81 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:13.182169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 614/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:13.187906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a10e-f01e-494e-a3b3-759733e8e3a3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:13.265078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:13.286270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a10e-f01e-494e-a3b3-759733e8e3a3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:13.321300 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aa1ac-4f30-4db0-8dc3-32d59adcbf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:13.322112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aa1ac-4f30-4db0-8dc3-32d59adcbf30 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:13.322399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aa1ac-4f30-4db0-8dc3-32d59adcbf30 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:13.322680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aa1ac-4f30-4db0-8dc3-32d59adcbf30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:13.329135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aa1ac-4f30-4db0-8dc3-32d59adcbf30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:13.330573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aa1ac-4f30-4db0-8dc3-32d59adcbf30 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e74aa1ac-4f30-4db0-8dc3-32d59adcbf30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:31:13.345072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:13.346137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:13.353941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:31:13.353941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:31:13.353941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:31:13.353941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:31:13.353941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:31:13.353941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:31:13.353941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:13.353941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:13.353941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 630/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:31:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:31:13.354607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c65fc-b526-49c2-954c-e16adad9ca81 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:13.451095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c65fc-b526-49c2-954c-e16adad9ca81 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:13.484538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eef4b0-425c-4771-88aa-6cab13a897ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:13.485194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef4b0-425c-4771-88aa-6cab13a897ad None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:13.485543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef4b0-425c-4771-88aa-6cab13a897ad None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:13.485824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eef4b0-425c-4771-88aa-6cab13a897ad None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:13.486652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eef4b0-425c-4771-88aa-6cab13a897ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:13.487019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eef4b0-425c-4771-88aa-6cab13a897ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:13.488462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eef4b0-425c-4771-88aa-6cab13a897ad None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:13.501544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 615/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:31:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:13.508259 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aa1ac-4f30-4db0-8dc3-32d59adcbf30 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:13.607331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aa1ac-4f30-4db0-8dc3-32d59adcbf30 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:13.640169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5efdcf-ef7b-42b7-95c4-4869f5955042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:13.640814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5efdcf-ef7b-42b7-95c4-4869f5955042 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:13.641098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5efdcf-ef7b-42b7-95c4-4869f5955042 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:13.641374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5efdcf-ef7b-42b7-95c4-4869f5955042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:13.642194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5efdcf-ef7b-42b7-95c4-4869f5955042 None admin] RBAC: Adding query filter params (role.id=ea353bbe72d949cb9417cea310e8d194, scope.project.id=0ec77816151b45228e087023588839da, user.id=87fd5580ed264a08a3ad31850e0a53a4) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:13.642505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5efdcf-ef7b-42b7-95c4-4869f5955042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:13.644003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5efdcf-ef7b-42b7-95c4-4869f5955042 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:13.650398 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 631/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:31:13 2022] GET /identity/v3/role_assignments?user.id=87fd5580ed264a08a3ad31850e0a53a4&scope.project.id=0ec77816151b45228e087023588839da&role.id=ea353bbe72d949cb9417cea310e8d194 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:31:15.753479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5420e-755d-494a-9245-5ac1616dcfbb None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:15.754022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5420e-755d-494a-9245-5ac1616dcfbb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:15.754022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5420e-755d-494a-9245-5ac1616dcfbb None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:15.755501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 616/1247] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:15.761470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7d1e1-273c-4aa0-9199-a00b490546c1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:15.761885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7d1e1-273c-4aa0-9199-a00b490546c1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:15.762028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd7d1e1-273c-4aa0-9199-a00b490546c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:15.767102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:15.779654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3dd7d1e1-273c-4aa0-9199-a00b490546c1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:15.780859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3dd7d1e1-273c-4aa0-9199-a00b490546c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:15.846432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 632/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:15.871653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5420e-755d-494a-9245-5ac1616dcfbb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:15.890741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:15.974056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5420e-755d-494a-9245-5ac1616dcfbb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:16.008906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24519fb-a946-4976-a279-80620f2deb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:16.010056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24519fb-a946-4976-a279-80620f2deb84 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:16.010056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24519fb-a946-4976-a279-80620f2deb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:16.010226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24519fb-a946-4976-a279-80620f2deb84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:16.020495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24519fb-a946-4976-a279-80620f2deb84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a24519fb-a946-4976-a279-80620f2deb84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:31:16.028278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:16.029379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:16.030241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 617/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:16.035456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7d1e1-273c-4aa0-9199-a00b490546c1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:16.133209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd7d1e1-273c-4aa0-9199-a00b490546c1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:16.162255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:16.167268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73a9b8-f281-40bf-9aff-4883af314feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:16.167937 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73a9b8-f281-40bf-9aff-4883af314feb None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:16.168224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73a9b8-f281-40bf-9aff-4883af314feb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:16.168501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73a9b8-f281-40bf-9aff-4883af314feb None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:16.169246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73a9b8-f281-40bf-9aff-4883af314feb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:16.169553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73a9b8-f281-40bf-9aff-4883af314feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:16.170975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73a9b8-f281-40bf-9aff-4883af314feb None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:16.179498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 633/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:31:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:16.185204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24519fb-a946-4976-a279-80620f2deb84 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:16.261912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:16.283841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24519fb-a946-4976-a279-80620f2deb84 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:16.317395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b4f0f-5582-4652-a3a7-6bd58dcd1e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:16.318241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b4f0f-5582-4652-a3a7-6bd58dcd1e68 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:16.318499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b4f0f-5582-4652-a3a7-6bd58dcd1e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:16.318976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b4f0f-5582-4652-a3a7-6bd58dcd1e68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:16.329183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b4f0f-5582-4652-a3a7-6bd58dcd1e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:16.330630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3b4f0f-5582-4652-a3a7-6bd58dcd1e68 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-af3b4f0f-5582-4652-a3a7-6bd58dcd1e68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:16.348391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:16.350071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:16.351080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:16.351080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:16.351080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:16.351080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:16.351080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 618/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:16.356672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73a9b8-f281-40bf-9aff-4883af314feb None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:16.455770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73a9b8-f281-40bf-9aff-4883af314feb None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:16.488541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0770aa2-413d-40d6-8277-438c95f239e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:16.489196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0770aa2-413d-40d6-8277-438c95f239e0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:16.489481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0770aa2-413d-40d6-8277-438c95f239e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:16.489758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0770aa2-413d-40d6-8277-438c95f239e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:16.491235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0770aa2-413d-40d6-8277-438c95f239e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:16.491551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0770aa2-413d-40d6-8277-438c95f239e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:16.493182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0770aa2-413d-40d6-8277-438c95f239e0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:16.504570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 634/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:16.510341 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b4f0f-5582-4652-a3a7-6bd58dcd1e68 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:16.608965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b4f0f-5582-4652-a3a7-6bd58dcd1e68 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:16.634901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:16.642715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ea80f-5cad-4d83-af0b-ffc26201fd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:16.643547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ea80f-5cad-4d83-af0b-ffc26201fd99 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:16.643831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ea80f-5cad-4d83-af0b-ffc26201fd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:16.644108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ea80f-5cad-4d83-af0b-ffc26201fd99 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:16.652645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ea80f-5cad-4d83-af0b-ffc26201fd99 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:16.654081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757ea80f-5cad-4d83-af0b-ffc26201fd99 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-757ea80f-5cad-4d83-af0b-ffc26201fd99 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:31:16.669129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:16.670256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:16.671495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 619/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:16.676115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0770aa2-413d-40d6-8277-438c95f239e0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:16.731561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:16.774805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0770aa2-413d-40d6-8277-438c95f239e0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:16.807640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723c0e-5ced-4462-be00-634a8f32c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:16.808294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723c0e-5ced-4462-be00-634a8f32c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:16.808574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723c0e-5ced-4462-be00-634a8f32c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:16.808848 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78723c0e-5ced-4462-be00-634a8f32c0c5 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:16.809671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723c0e-5ced-4462-be00-634a8f32c0c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:16.809979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723c0e-5ced-4462-be00-634a8f32c0c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:16.811425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78723c0e-5ced-4462-be00-634a8f32c0c5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:16.827974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 635/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 09:31:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:16.834214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ea80f-5cad-4d83-af0b-ffc26201fd99 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:16.933985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ea80f-5cad-4d83-af0b-ffc26201fd99 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:16.967135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badf1f-bea1-46bc-96a4-325afd4f364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:16.967774 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badf1f-bea1-46bc-96a4-325afd4f364c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:16.968058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badf1f-bea1-46bc-96a4-325afd4f364c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:16.968338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badf1f-bea1-46bc-96a4-325afd4f364c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:17.023796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:17.035916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65badf1f-bea1-46bc-96a4-325afd4f364c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:17.038110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65badf1f-bea1-46bc-96a4-325afd4f364c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:17.132080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 620/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:31:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:31:17.138041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723c0e-5ced-4462-be00-634a8f32c0c5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:17.239914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78723c0e-5ced-4462-be00-634a8f32c0c5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:17.252883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:17.273498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966b8e-3586-4861-ada8-9206b8dca6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:17.274336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966b8e-3586-4861-ada8-9206b8dca6de None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:17.274571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966b8e-3586-4861-ada8-9206b8dca6de None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:17.274861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f966b8e-3586-4861-ada8-9206b8dca6de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:17.284537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f966b8e-3586-4861-ada8-9206b8dca6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:17.285980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f966b8e-3586-4861-ada8-9206b8dca6de None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-0f966b8e-3586-4861-ada8-9206b8dca6de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:17.303885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:17.304929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:17.306049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:17.306049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:17.306049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:17.306049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:17.306049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 636/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:17.310975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badf1f-bea1-46bc-96a4-325afd4f364c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:17.399516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:17.411351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badf1f-bea1-46bc-96a4-325afd4f364c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:17.444413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107a4d-9fdc-4c98-ac13-4f60efc62984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:17.445065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107a4d-9fdc-4c98-ac13-4f60efc62984 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:17.445348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107a4d-9fdc-4c98-ac13-4f60efc62984 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:17.445623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc107a4d-9fdc-4c98-ac13-4f60efc62984 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:17.446340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107a4d-9fdc-4c98-ac13-4f60efc62984 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:17.446642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107a4d-9fdc-4c98-ac13-4f60efc62984 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:17.448061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc107a4d-9fdc-4c98-ac13-4f60efc62984 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:17.459288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 621/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:17.465468 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966b8e-3586-4861-ada8-9206b8dca6de None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:17.565462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f966b8e-3586-4861-ada8-9206b8dca6de None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:17.600779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62d69-7580-40d1-a71d-0be9ec99c74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:17.601574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62d69-7580-40d1-a71d-0be9ec99c74d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:17.601860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62d69-7580-40d1-a71d-0be9ec99c74d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:17.602136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62d69-7580-40d1-a71d-0be9ec99c74d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:17.608613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc62d69-7580-40d1-a71d-0be9ec99c74d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:17.611664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc62d69-7580-40d1-a71d-0be9ec99c74d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-efc62d69-7580-40d1-a71d-0be9ec99c74d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:31:17.624159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:17.625210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:17.626315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:31:17.626315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:31:17.626315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:31:17.626315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:31:17.626315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:31:17.626315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:31:17.626315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:17.626315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:17.626315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 637/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 09:31:17.631245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107a4d-9fdc-4c98-ac13-4f60efc62984 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:17.730978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc107a4d-9fdc-4c98-ac13-4f60efc62984 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:17.764307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58567bd-4295-4740-ae64-3e27fbc3b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:17.764962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58567bd-4295-4740-ae64-3e27fbc3b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:17.765246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58567bd-4295-4740-ae64-3e27fbc3b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:17.765527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58567bd-4295-4740-ae64-3e27fbc3b8f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:17.766304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58567bd-4295-4740-ae64-3e27fbc3b8f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:17.766615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58567bd-4295-4740-ae64-3e27fbc3b8f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:17.768080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58567bd-4295-4740-ae64-3e27fbc3b8f1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:17.780763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 622/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:17.786800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62d69-7580-40d1-a71d-0be9ec99c74d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:17.813838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:17.887628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62d69-7580-40d1-a71d-0be9ec99c74d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:17.921405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e209e2-f4ec-49cc-9c5b-4706d7c9ec47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:17.922055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e209e2-f4ec-49cc-9c5b-4706d7c9ec47 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:17.922369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e209e2-f4ec-49cc-9c5b-4706d7c9ec47 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:17.922647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e209e2-f4ec-49cc-9c5b-4706d7c9ec47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:17.923509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e209e2-f4ec-49cc-9c5b-4706d7c9ec47 None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=0ec77816151b45228e087023588839da, user.id=87fd5580ed264a08a3ad31850e0a53a4) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:17.928169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e209e2-f4ec-49cc-9c5b-4706d7c9ec47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:17.928169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e209e2-f4ec-49cc-9c5b-4706d7c9ec47 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:17.931056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 638/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:31:17 2022] GET /identity/v3/role_assignments?user.id=87fd5580ed264a08a3ad31850e0a53a4&scope.project.id=0ec77816151b45228e087023588839da&role.id=9312183c32b04118985c8316f33f3830 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:19.971419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39e22-2aec-4e1f-b189-fcae2fef3dd9 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:19.971990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39e22-2aec-4e1f-b189-fcae2fef3dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:19.971990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f39e22-2aec-4e1f-b189-fcae2fef3dd9 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:19.973354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 623/1261] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:19.979846 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661040c-51cf-4a92-a8d7-8192da84f072 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:19.980278 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661040c-51cf-4a92-a8d7-8192da84f072 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:19.980410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661040c-51cf-4a92-a8d7-8192da84f072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:19.997239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9661040c-51cf-4a92-a8d7-8192da84f072 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:19.998427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9661040c-51cf-4a92-a8d7-8192da84f072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:20.063455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 639/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:20.087241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39e22-2aec-4e1f-b189-fcae2fef3dd9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:20.097941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:20.184720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f39e22-2aec-4e1f-b189-fcae2fef3dd9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:20.218063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3831024-7274-47b2-9c71-b1728daa54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:20.218875 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3831024-7274-47b2-9c71-b1728daa54ca None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:20.219156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3831024-7274-47b2-9c71-b1728daa54ca None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:20.219434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3831024-7274-47b2-9c71-b1728daa54ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:20.229649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3831024-7274-47b2-9c71-b1728daa54ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c3831024-7274-47b2-9c71-b1728daa54ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:31:20.237321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:20.238500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:20.244624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 624/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:31:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:20.245462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661040c-51cf-4a92-a8d7-8192da84f072 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:20.263892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:20.342322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661040c-51cf-4a92-a8d7-8192da84f072 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:20.375926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7331bd-0cb1-4d5d-8076-cdee4746c5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:20.376620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7331bd-0cb1-4d5d-8076-cdee4746c5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:20.376905 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7331bd-0cb1-4d5d-8076-cdee4746c5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:20.377182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7331bd-0cb1-4d5d-8076-cdee4746c5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:20.377926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7331bd-0cb1-4d5d-8076-cdee4746c5c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:20.378232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7331bd-0cb1-4d5d-8076-cdee4746c5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:20.379626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7331bd-0cb1-4d5d-8076-cdee4746c5c5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:20.388242 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 640/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:31:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:20.394072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3831024-7274-47b2-9c71-b1728daa54ca None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:20.461259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:20.493869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3831024-7274-47b2-9c71-b1728daa54ca None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:20.526543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d7f63-3bbc-4ece-b0f9-d96029e2bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:20.527395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d7f63-3bbc-4ece-b0f9-d96029e2bf3d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:20.527677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d7f63-3bbc-4ece-b0f9-d96029e2bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:20.527949 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d7f63-3bbc-4ece-b0f9-d96029e2bf3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:20.539139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d7f63-3bbc-4ece-b0f9-d96029e2bf3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:20.546755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d7f63-3bbc-4ece-b0f9-d96029e2bf3d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-100d7f63-3bbc-4ece-b0f9-d96029e2bf3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:20.557629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:20.558769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:20.560129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:20.560129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:20.560129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:20.560129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:20.560129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 625/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:20.564664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7331bd-0cb1-4d5d-8076-cdee4746c5c5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:20.645814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:20.664606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7331bd-0cb1-4d5d-8076-cdee4746c5c5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:20.698939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f6669-41e0-4d9b-8468-ffa5b131e722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:20.699633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f6669-41e0-4d9b-8468-ffa5b131e722 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:20.699919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f6669-41e0-4d9b-8468-ffa5b131e722 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:20.700197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f6669-41e0-4d9b-8468-ffa5b131e722 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:20.700942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f6669-41e0-4d9b-8468-ffa5b131e722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:20.701303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f6669-41e0-4d9b-8468-ffa5b131e722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:20.702644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f6669-41e0-4d9b-8468-ffa5b131e722 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:20.714287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 641/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:20.719937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d7f63-3bbc-4ece-b0f9-d96029e2bf3d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:20.821506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d7f63-3bbc-4ece-b0f9-d96029e2bf3d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:20.842636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:20.857218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20cd1-d730-450d-bbdb-4a08cd984a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:20.858023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20cd1-d730-450d-bbdb-4a08cd984a2e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:20.858310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20cd1-d730-450d-bbdb-4a08cd984a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:20.858589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20cd1-d730-450d-bbdb-4a08cd984a2e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:20.866951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c20cd1-d730-450d-bbdb-4a08cd984a2e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:20.868703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c20cd1-d730-450d-bbdb-4a08cd984a2e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b2c20cd1-d730-450d-bbdb-4a08cd984a2e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:31:20.883106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:20.884145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:20.885143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 626/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:20.890109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f6669-41e0-4d9b-8468-ffa5b131e722 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:20.988777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f6669-41e0-4d9b-8468-ffa5b131e722 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:21.024304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933299b2-b124-4ab5-b25a-202d5cf3474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:21.024972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933299b2-b124-4ab5-b25a-202d5cf3474c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:21.025258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933299b2-b124-4ab5-b25a-202d5cf3474c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:21.025537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933299b2-b124-4ab5-b25a-202d5cf3474c None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:21.026374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933299b2-b124-4ab5-b25a-202d5cf3474c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:21.026686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933299b2-b124-4ab5-b25a-202d5cf3474c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:21.028142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933299b2-b124-4ab5-b25a-202d5cf3474c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:21.038425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:21.046642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 642/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 09:31:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:21.052293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20cd1-d730-450d-bbdb-4a08cd984a2e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:21.152815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20cd1-d730-450d-bbdb-4a08cd984a2e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:21.186695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3e7ab-b1dc-4a86-be19-755e11e3227f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:21.187536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3e7ab-b1dc-4a86-be19-755e11e3227f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:21.187820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3e7ab-b1dc-4a86-be19-755e11e3227f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:21.188095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c3e7ab-b1dc-4a86-be19-755e11e3227f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:21.198623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3e7ab-b1dc-4a86-be19-755e11e3227f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:21.200098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c3e7ab-b1dc-4a86-be19-755e11e3227f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-80c3e7ab-b1dc-4a86-be19-755e11e3227f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:21.217523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:21.218594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:21.219734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:21.219734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:21.219734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:21.219734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:21.219734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 627/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:21.225126 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933299b2-b124-4ab5-b25a-202d5cf3474c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:21.325210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933299b2-b124-4ab5-b25a-202d5cf3474c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:21.359792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16dc09-ee35-427f-9071-467e18c4f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:21.360438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16dc09-ee35-427f-9071-467e18c4f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:21.360722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16dc09-ee35-427f-9071-467e18c4f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:21.360993 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16dc09-ee35-427f-9071-467e18c4f1eb None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:21.361695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16dc09-ee35-427f-9071-467e18c4f1eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:21.361998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16dc09-ee35-427f-9071-467e18c4f1eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:21.363378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b16dc09-ee35-427f-9071-467e18c4f1eb None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:21.374824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 643/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:21.380701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3e7ab-b1dc-4a86-be19-755e11e3227f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:21.413114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:21.480249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c3e7ab-b1dc-4a86-be19-755e11e3227f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:21.514065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db08e4-6212-4f57-a747-3eebd732c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:21.514928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db08e4-6212-4f57-a747-3eebd732c91e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:21.515160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db08e4-6212-4f57-a747-3eebd732c91e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:21.515439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db08e4-6212-4f57-a747-3eebd732c91e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:21.522760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db08e4-6212-4f57-a747-3eebd732c91e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:21.524229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db08e4-6212-4f57-a747-3eebd732c91e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b6db08e4-6212-4f57-a747-3eebd732c91e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:31:21.538175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:21.540736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:21.541917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:31:21.541917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:31:21.541917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:31:21.541917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:31:21.541917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:31:21.541917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:31:21.541917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:21.541917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:21.541917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 628/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:21.545480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16dc09-ee35-427f-9071-467e18c4f1eb None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:21.603170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:21.644015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b16dc09-ee35-427f-9071-467e18c4f1eb None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:21.677168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fe3fb-77aa-4e99-9db1-74c4c7fe5367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:21.677815 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fe3fb-77aa-4e99-9db1-74c4c7fe5367 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:21.678099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fe3fb-77aa-4e99-9db1-74c4c7fe5367 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:21.678378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fe3fb-77aa-4e99-9db1-74c4c7fe5367 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:21.679193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fe3fb-77aa-4e99-9db1-74c4c7fe5367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:21.679529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fe3fb-77aa-4e99-9db1-74c4c7fe5367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:21.680945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fe3fb-77aa-4e99-9db1-74c4c7fe5367 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:21.692656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 644/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:21.699333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db08e4-6212-4f57-a747-3eebd732c91e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:21.792907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:21.801538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db08e4-6212-4f57-a747-3eebd732c91e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:21.836182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701995e-aeb1-4165-86cd-c43826ba6e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:21.837088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701995e-aeb1-4165-86cd-c43826ba6e2d None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:21.837367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701995e-aeb1-4165-86cd-c43826ba6e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:21.837641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701995e-aeb1-4165-86cd-c43826ba6e2d None admin] PATH_INFO: `/v3/projects/0ec77816151b45228e087023588839da/users/87fd5580ed264a08a3ad31850e0a53a4/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:21.839619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701995e-aeb1-4165-86cd-c43826ba6e2d None admin] RBAC: Authorizing `identity:create_grant(project_id=0ec77816151b45228e087023588839da, user_id=87fd5580ed264a08a3ad31850e0a53a4, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:21.841043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701995e-aeb1-4165-86cd-c43826ba6e2d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:21.976798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 629/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 09:31:21 2022] PUT /identity/v3/projects/0ec77816151b45228e087023588839da/users/87fd5580ed264a08a3ad31850e0a53a4/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:31:23.995236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e8f90-7f72-473e-aefd-20c5252fbc1f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:23.995916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e8f90-7f72-473e-aefd-20c5252fbc1f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:23.995916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e8f90-7f72-473e-aefd-20c5252fbc1f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:23.997105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 645/1274] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:24.002425 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de9b1e-6fad-438b-b7e9-8606aa78c884 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:24.003168 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de9b1e-6fad-438b-b7e9-8606aa78c884 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:24.003404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de9b1e-6fad-438b-b7e9-8606aa78c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:24.022353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-18de9b1e-6fad-438b-b7e9-8606aa78c884 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:24.023755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-18de9b1e-6fad-438b-b7e9-8606aa78c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:24.088346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 630/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:24.111913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e8f90-7f72-473e-aefd-20c5252fbc1f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:24.215730 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e8f90-7f72-473e-aefd-20c5252fbc1f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:24.233085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:24.250304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1db3a2-f388-41d8-b99c-84fc338e48ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:24.251078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1db3a2-f388-41d8-b99c-84fc338e48ea None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:24.251373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1db3a2-f388-41d8-b99c-84fc338e48ea None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:24.251648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1db3a2-f388-41d8-b99c-84fc338e48ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:24.262357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1db3a2-f388-41d8-b99c-84fc338e48ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-fe1db3a2-f388-41d8-b99c-84fc338e48ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 09:31:24.270319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:24.271497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:24.272483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 646/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 09:31:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:24.277831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de9b1e-6fad-438b-b7e9-8606aa78c884 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:24.361334 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:24.379390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de9b1e-6fad-438b-b7e9-8606aa78c884 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:24.411929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c1e8b-f32f-4878-a63c-c152f2a80649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:24.412631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c1e8b-f32f-4878-a63c-c152f2a80649 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:24.412889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c1e8b-f32f-4878-a63c-c152f2a80649 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:24.413166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c1e8b-f32f-4878-a63c-c152f2a80649 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:24.413908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c1e8b-f32f-4878-a63c-c152f2a80649 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:24.414217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c1e8b-f32f-4878-a63c-c152f2a80649 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:24.415673 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c1e8b-f32f-4878-a63c-c152f2a80649 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:24.423422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 631/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 09:31:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:24.430529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1db3a2-f388-41d8-b99c-84fc338e48ea None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:24.531231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1db3a2-f388-41d8-b99c-84fc338e48ea None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:24.564892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deabac-0b1e-425a-ab57-955b87de67be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:24.568817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deabac-0b1e-425a-ab57-955b87de67be None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:24.568817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deabac-0b1e-425a-ab57-955b87de67be None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:24.568817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deabac-0b1e-425a-ab57-955b87de67be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:24.576650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39deabac-0b1e-425a-ab57-955b87de67be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:24.578149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39deabac-0b1e-425a-ab57-955b87de67be None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-39deabac-0b1e-425a-ab57-955b87de67be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:24.595088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:24.596167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:24.597067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:24.597067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:24.597067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:24.597067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:24.597067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 647/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:24.602611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c1e8b-f32f-4878-a63c-c152f2a80649 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:24.702224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c1e8b-f32f-4878-a63c-c152f2a80649 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:24.737142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c3cf-8dd7-4179-9749-56dce385bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:24.737798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c3cf-8dd7-4179-9749-56dce385bf1e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:24.738081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c3cf-8dd7-4179-9749-56dce385bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:24.738359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28c3cf-8dd7-4179-9749-56dce385bf1e None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:24.739100 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c3cf-8dd7-4179-9749-56dce385bf1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:24.739407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c3cf-8dd7-4179-9749-56dce385bf1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:24.741523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da28c3cf-8dd7-4179-9749-56dce385bf1e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:24.753315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 632/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:24.762003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deabac-0b1e-425a-ab57-955b87de67be None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:24.791090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:24.858385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deabac-0b1e-425a-ab57-955b87de67be None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:24.891351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335453-98ee-467b-9f2e-7cd2c6caacf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:24.892135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335453-98ee-467b-9f2e-7cd2c6caacf9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:24.898515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335453-98ee-467b-9f2e-7cd2c6caacf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:24.898515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e335453-98ee-467b-9f2e-7cd2c6caacf9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:24.904436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335453-98ee-467b-9f2e-7cd2c6caacf9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:24.905886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e335453-98ee-467b-9f2e-7cd2c6caacf9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-5e335453-98ee-467b-9f2e-7cd2c6caacf9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 09:31:24.920500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:24.921690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:24.922895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 648/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:24.927591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c3cf-8dd7-4179-9749-56dce385bf1e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:24.932031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:25.026129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28c3cf-8dd7-4179-9749-56dce385bf1e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:25.059919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c6ebf-7620-49fd-9bb0-794d1a73cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:25.060519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c6ebf-7620-49fd-9bb0-794d1a73cec9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:25.061573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c6ebf-7620-49fd-9bb0-794d1a73cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:25.061865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c6ebf-7620-49fd-9bb0-794d1a73cec9 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:25.062713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c6ebf-7620-49fd-9bb0-794d1a73cec9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:25.063081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c6ebf-7620-49fd-9bb0-794d1a73cec9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:25.064535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c6ebf-7620-49fd-9bb0-794d1a73cec9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:25.083611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 633/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 09:31:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:25.090020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335453-98ee-467b-9f2e-7cd2c6caacf9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:25.178850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:25.187941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e335453-98ee-467b-9f2e-7cd2c6caacf9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:25.220263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9de5da-f0bc-4b18-b703-e9a9b698dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:25.220930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9de5da-f0bc-4b18-b703-e9a9b698dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:25.221220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9de5da-f0bc-4b18-b703-e9a9b698dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:25.221503 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9de5da-f0bc-4b18-b703-e9a9b698dcb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:25.286929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9de5da-f0bc-4b18-b703-e9a9b698dcb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:25.289334 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9de5da-f0bc-4b18-b703-e9a9b698dcb9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:25.380130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:25.391471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 649/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 09:31:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 09:31:25.398363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c6ebf-7620-49fd-9bb0-794d1a73cec9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:25.465182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:25.502240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c6ebf-7620-49fd-9bb0-794d1a73cec9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:25.536210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75d5c6-7cbd-41d3-a0b2-58f9d23dfcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:25.537038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75d5c6-7cbd-41d3-a0b2-58f9d23dfcbb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:25.537324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75d5c6-7cbd-41d3-a0b2-58f9d23dfcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:25.537782 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75d5c6-7cbd-41d3-a0b2-58f9d23dfcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:25.547883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75d5c6-7cbd-41d3-a0b2-58f9d23dfcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:25.549330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75d5c6-7cbd-41d3-a0b2-58f9d23dfcbb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ed75d5c6-7cbd-41d3-a0b2-58f9d23dfcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 09:31:25.566545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:25.576929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:25.578035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 09:31:25.578035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 09:31:25.578035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 09:31:25.578035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:25.578035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 634/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:25.578387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9de5da-f0bc-4b18-b703-e9a9b698dcb9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:25.674705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9de5da-f0bc-4b18-b703-e9a9b698dcb9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:25.708607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353a389-11f0-4cc2-954e-b6473a3adeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:25.709461 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353a389-11f0-4cc2-954e-b6473a3adeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:25.709747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353a389-11f0-4cc2-954e-b6473a3adeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:25.710026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353a389-11f0-4cc2-954e-b6473a3adeb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:25.710740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353a389-11f0-4cc2-954e-b6473a3adeb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:25.711083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353a389-11f0-4cc2-954e-b6473a3adeb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:25.712446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353a389-11f0-4cc2-954e-b6473a3adeb1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:25.724061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 650/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 09:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:25.729667 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75d5c6-7cbd-41d3-a0b2-58f9d23dfcbb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:25.831847 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75d5c6-7cbd-41d3-a0b2-58f9d23dfcbb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:25.845923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:25.866304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72309169-aa23-4194-94df-42489246f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:25.867119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72309169-aa23-4194-94df-42489246f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:25.867658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72309169-aa23-4194-94df-42489246f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:25.867937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72309169-aa23-4194-94df-42489246f2b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:25.874722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72309169-aa23-4194-94df-42489246f2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:25.876232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72309169-aa23-4194-94df-42489246f2b8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-72309169-aa23-4194-94df-42489246f2b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 09:31:25.890988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:25.892743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:25.894944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:31:25.894944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:31:25.894944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:31:25.894944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:31:25.894944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:31:25.894944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:31:25.894944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 09:31:25.894944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 09:31:25.894944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 635/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 09:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:25.899837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353a389-11f0-4cc2-954e-b6473a3adeb1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:25.948968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:25.997114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353a389-11f0-4cc2-954e-b6473a3adeb1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:26.031570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2fde2a-9072-49f5-b91f-71ab9960281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:26.032221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fde2a-9072-49f5-b91f-71ab9960281c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:26.032505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fde2a-9072-49f5-b91f-71ab9960281c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:26.032779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2fde2a-9072-49f5-b91f-71ab9960281c None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:26.033551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fde2a-9072-49f5-b91f-71ab9960281c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:26.033956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fde2a-9072-49f5-b91f-71ab9960281c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:26.036444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2fde2a-9072-49f5-b91f-71ab9960281c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:26.055335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 651/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 09:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:26.061562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72309169-aa23-4194-94df-42489246f2b8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:26.167633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72309169-aa23-4194-94df-42489246f2b8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:26.202102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44eadda-1d53-4120-86d9-4aa0a050996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:26.202700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eadda-1d53-4120-86d9-4aa0a050996d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:26.203010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eadda-1d53-4120-86d9-4aa0a050996d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:26.203285 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44eadda-1d53-4120-86d9-4aa0a050996d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:26.204106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eadda-1d53-4120-86d9-4aa0a050996d None admin] RBAC: Adding query filter params (role.id=9312183c32b04118985c8316f33f3830, scope.project.id=0ec77816151b45228e087023588839da, user.id=87fd5580ed264a08a3ad31850e0a53a4) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:26.204414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eadda-1d53-4120-86d9-4aa0a050996d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:26.205843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44eadda-1d53-4120-86d9-4aa0a050996d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:26.211696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 636/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 09:31:26 2022] GET /identity/v3/role_assignments?user.id=87fd5580ed264a08a3ad31850e0a53a4&scope.project.id=0ec77816151b45228e087023588839da&role.id=9312183c32b04118985c8316f33f3830 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:31:28.277017 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179de93f-d8a4-4cb8-9131-118b6350679c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:28.277573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179de93f-d8a4-4cb8-9131-118b6350679c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:28.277573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179de93f-d8a4-4cb8-9131-118b6350679c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:28.278997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 652/1288] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:28.284231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4acec-d6f5-4cce-ac59-578d55183b1a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:28.284651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4acec-d6f5-4cce-ac59-578d55183b1a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:28.284789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4acec-d6f5-4cce-ac59-578d55183b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:28.301720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-cdf4acec-d6f5-4cce-ac59-578d55183b1a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:28.303045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cdf4acec-d6f5-4cce-ac59-578d55183b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:28.332208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:28.367815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 637/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:28.391018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179de93f-d8a4-4cb8-9131-118b6350679c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:28.491794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179de93f-d8a4-4cb8-9131-118b6350679c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:28.502367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:28.525854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45bf62-b129-4764-9192-b806cd66230a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:28.526648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45bf62-b129-4764-9192-b806cd66230a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:28.526968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45bf62-b129-4764-9192-b806cd66230a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:28.527294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45bf62-b129-4764-9192-b806cd66230a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:28.527892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45bf62-b129-4764-9192-b806cd66230a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:28.529267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45bf62-b129-4764-9192-b806cd66230a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-df45bf62-b129-4764-9192-b806cd66230a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:28.540922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:28.542103 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:28.543012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 653/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:31:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:28.548084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4acec-d6f5-4cce-ac59-578d55183b1a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:28.647762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4acec-d6f5-4cce-ac59-578d55183b1a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:28.682730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20d4ce-f2a6-4c49-8994-7de341e11266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:28.683425 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20d4ce-f2a6-4c49-8994-7de341e11266 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:28.683708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20d4ce-f2a6-4c49-8994-7de341e11266 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:28.683980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20d4ce-f2a6-4c49-8994-7de341e11266 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:28.684674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20d4ce-f2a6-4c49-8994-7de341e11266 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:28.684977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20d4ce-f2a6-4c49-8994-7de341e11266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:28.686349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20d4ce-f2a6-4c49-8994-7de341e11266 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:28.691080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 638/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 09:31:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:28.697951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45bf62-b129-4764-9192-b806cd66230a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:28.796002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45bf62-b129-4764-9192-b806cd66230a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:28.829652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5b4d6-b5e9-4bee-8acb-c805d4718007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:28.830309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5b4d6-b5e9-4bee-8acb-c805d4718007 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:28.830596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5b4d6-b5e9-4bee-8acb-c805d4718007 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:28.830903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5b4d6-b5e9-4bee-8acb-c805d4718007 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:28.831604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5b4d6-b5e9-4bee-8acb-c805d4718007 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:28.831951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5b4d6-b5e9-4bee-8acb-c805d4718007 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:28.833308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5b4d6-b5e9-4bee-8acb-c805d4718007 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:28.837882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 654/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 09:31:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:30.830720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32be33e-6d1d-4214-920d-e2a7fab8e086 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:30.831296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32be33e-6d1d-4214-920d-e2a7fab8e086 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:30.831296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32be33e-6d1d-4214-920d-e2a7fab8e086 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:30.832680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 639/1293] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:30.838827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03664c84-2923-46b8-a5b0-bf79c0dfe2c4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:30.839340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03664c84-2923-46b8-a5b0-bf79c0dfe2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:30.839435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03664c84-2923-46b8-a5b0-bf79c0dfe2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:30.858955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-03664c84-2923-46b8-a5b0-bf79c0dfe2c4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:30.858955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-03664c84-2923-46b8-a5b0-bf79c0dfe2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:30.891095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:30.932006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 655/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:30.956498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32be33e-6d1d-4214-920d-e2a7fab8e086 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:30.991838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:31.067041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32be33e-6d1d-4214-920d-e2a7fab8e086 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:31.103429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f79a1c-566c-4bd0-91c6-b45a0f787c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:31.104172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79a1c-566c-4bd0-91c6-b45a0f787c6f None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:31.104471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79a1c-566c-4bd0-91c6-b45a0f787c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:31.105005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79a1c-566c-4bd0-91c6-b45a0f787c6f None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:31.105960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f79a1c-566c-4bd0-91c6-b45a0f787c6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:31.108144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f79a1c-566c-4bd0-91c6-b45a0f787c6f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:31.203226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 640/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 09:31:30 2022] POST /identity/v3/services => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:31:33.252858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5eefc-7400-4882-a190-fa6931616b2f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:33.253389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5eefc-7400-4882-a190-fa6931616b2f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:33.253484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5eefc-7400-4882-a190-fa6931616b2f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:33.254811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 656/1296] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:33.260972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6e036-62b7-4100-b6ed-a213e811c019 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:33.261408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6e036-62b7-4100-b6ed-a213e811c019 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:33.261526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6e036-62b7-4100-b6ed-a213e811c019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:33.278206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8fa6e036-62b7-4100-b6ed-a213e811c019 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:33.279413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8fa6e036-62b7-4100-b6ed-a213e811c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:33.351173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 641/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:33.375336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5eefc-7400-4882-a190-fa6931616b2f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:33.477752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5eefc-7400-4882-a190-fa6931616b2f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:33.513116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be81cc-0926-4160-9c9f-6871e376da92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:33.513847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be81cc-0926-4160-9c9f-6871e376da92 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:33.514132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be81cc-0926-4160-9c9f-6871e376da92 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:33.514487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be81cc-0926-4160-9c9f-6871e376da92 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:33.515190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be81cc-0926-4160-9c9f-6871e376da92 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:33.516579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be81cc-0926-4160-9c9f-6871e376da92 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-f4be81cc-0926-4160-9c9f-6871e376da92 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:33.528837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:33.529818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:33.530693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 657/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:31:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:33.536067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6e036-62b7-4100-b6ed-a213e811c019 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:33.555329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:33.636497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6e036-62b7-4100-b6ed-a213e811c019 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:33.669739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfedc6f-9cfc-4fac-b83c-3c4751f8919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:33.670519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfedc6f-9cfc-4fac-b83c-3c4751f8919c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:33.670932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfedc6f-9cfc-4fac-b83c-3c4751f8919c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:33.671214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfedc6f-9cfc-4fac-b83c-3c4751f8919c None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:33.671922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfedc6f-9cfc-4fac-b83c-3c4751f8919c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:33.672232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfedc6f-9cfc-4fac-b83c-3c4751f8919c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:33.673615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfedc6f-9cfc-4fac-b83c-3c4751f8919c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:33.679418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 642/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 09:31:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:33.685327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be81cc-0926-4160-9c9f-6871e376da92 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:33.716977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:33.785079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be81cc-0926-4160-9c9f-6871e376da92 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:33.820038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e578749-68c6-4839-9030-9447126258ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:33.820686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578749-68c6-4839-9030-9447126258ac None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:33.820973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578749-68c6-4839-9030-9447126258ac None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:33.821250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578749-68c6-4839-9030-9447126258ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:33.822037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578749-68c6-4839-9030-9447126258ac None admin] RBAC: Adding query filter params (interface=public, service_id=cd4241791a3f4c938aec5dd46de2fd5f, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:33.822351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578749-68c6-4839-9030-9447126258ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:33.823927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578749-68c6-4839-9030-9447126258ac None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:33.828909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 658/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 09:31:33 2022] GET /identity/v3/endpoints?service_id=cd4241791a3f4c938aec5dd46de2fd5f&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:33.834764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfedc6f-9cfc-4fac-b83c-3c4751f8919c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:33.915810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:33.934111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfedc6f-9cfc-4fac-b83c-3c4751f8919c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:33.968311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0eb05-c00f-4d0a-9bbc-14e26b9315ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:33.968960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0eb05-c00f-4d0a-9bbc-14e26b9315ab None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:33.969241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0eb05-c00f-4d0a-9bbc-14e26b9315ab None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:33.969516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0eb05-c00f-4d0a-9bbc-14e26b9315ab None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:33.970188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0eb05-c00f-4d0a-9bbc-14e26b9315ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:33.971579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0eb05-c00f-4d0a-9bbc-14e26b9315ab None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:33.979426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 643/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 09:31:33 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:31:36.001930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9992aa6-efa0-4311-bb3c-eb73198613b8 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:36.002431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9992aa6-efa0-4311-bb3c-eb73198613b8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:36.002431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9992aa6-efa0-4311-bb3c-eb73198613b8 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:36.003861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 659/1302] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:31:36.009454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7b1c6-7510-46c3-8b36-62347df79fd2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:36.009877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7b1c6-7510-46c3-8b36-62347df79fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:36.010013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7b1c6-7510-46c3-8b36-62347df79fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:36.027239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a8e7b1c6-7510-46c3-8b36-62347df79fd2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:31:36.028408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a8e7b1c6-7510-46c3-8b36-62347df79fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:31:36.097440 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 644/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:31:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 09:31:36.120453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9992aa6-efa0-4311-bb3c-eb73198613b8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:36.215558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:36.222168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9992aa6-efa0-4311-bb3c-eb73198613b8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:36.255872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85a94a-9402-4da2-b75f-29d593d56a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:36.256750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85a94a-9402-4da2-b75f-29d593d56a44 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:36.257038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85a94a-9402-4da2-b75f-29d593d56a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:36.257315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85a94a-9402-4da2-b75f-29d593d56a44 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:36.257962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85a94a-9402-4da2-b75f-29d593d56a44 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:36.259392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85a94a-9402-4da2-b75f-29d593d56a44 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-9c85a94a-9402-4da2-b75f-29d593d56a44 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:31:36.271252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:31:36.272400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 09:31:36.273604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 660/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 09:31:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 09:31:36.278439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7b1c6-7510-46c3-8b36-62347df79fd2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:36.354398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:36.376857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7b1c6-7510-46c3-8b36-62347df79fd2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:36.410630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539971d-856b-4f3a-8f19-365b9907795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:36.411481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539971d-856b-4f3a-8f19-365b9907795e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:36.411703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539971d-856b-4f3a-8f19-365b9907795e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:36.411985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539971d-856b-4f3a-8f19-365b9907795e None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:36.412682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539971d-856b-4f3a-8f19-365b9907795e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:31:36.412992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539971d-856b-4f3a-8f19-365b9907795e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:36.414403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539971d-856b-4f3a-8f19-365b9907795e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:36.419371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 645/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 09:31:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:31:36.425253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85a94a-9402-4da2-b75f-29d593d56a44 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:31:36.522425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85a94a-9402-4da2-b75f-29d593d56a44 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:31:36.555049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1f6f8-7c1b-4b89-b2c5-91661efa2686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:31:36.555688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f6f8-7c1b-4b89-b2c5-91661efa2686 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:31:36.556011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f6f8-7c1b-4b89-b2c5-91661efa2686 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:31:36.556286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1f6f8-7c1b-4b89-b2c5-91661efa2686 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:31:36.557025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1f6f8-7c1b-4b89-b2c5-91661efa2686 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:31:36.558373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1f6f8-7c1b-4b89-b2c5-91661efa2686 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:31:36.633243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 661/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 09:31:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:31:46.422651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=30 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:31:46.627229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:39.642391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f21d-da5e-4f54-a684-585bf6ae040b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:39.643603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f21d-da5e-4f54-a684-585bf6ae040b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:39.644533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f21d-da5e-4f54-a684-585bf6ae040b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:39.656860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e310020-2326-4d48-9881-f06ad9d1cde6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:39.658141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e310020-2326-4d48-9881-f06ad9d1cde6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:39.659121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e310020-2326-4d48-9881-f06ad9d1cde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:39.662941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 646/1307] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:37:39 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:37:39.758894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7e310020-2326-4d48-9881-f06ad9d1cde6 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:37:39.761065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7e310020-2326-4d48-9881-f06ad9d1cde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:39.895246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 662/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:37:39.938501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca6d3-c94b-4a34-acde-25063a0c40de None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:39.946102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca6d3-c94b-4a34-acde-25063a0c40de None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:39.946102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ca6d3-c94b-4a34-acde-25063a0c40de None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:39.946102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 647/1309] 10.222.0.42 () {54 vars in 964 bytes} [Fri Jun 24 09:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:37:39.948619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b4297-c421-46af-aa84-b83d589d4c1c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:39.948921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b4297-c421-46af-aa84-b83d589d4c1c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:39.949204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b4297-c421-46af-aa84-b83d589d4c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:40.051855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-740b4297-c421-46af-aa84-b83d589d4c1c None None] MFA Rules not processed for user `9b2db60c511f4fd29b772ca5fb014d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:37:40.053081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-740b4297-c421-46af-aa84-b83d589d4c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:40.075948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:40.136647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 663/1310] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Jun 24 09:37:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:37:40.145911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ca6d3-c94b-4a34-acde-25063a0c40de None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:37:40.147673 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-493ca6d3-c94b-4a34-acde-25063a0c40de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:40.261601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ca6d3-c94b-4a34-acde-25063a0c40de None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:37:40.344682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7848038-5ca2-4005-86c1-917832b1231b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:37:40.345340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7848038-5ca2-4005-86c1-917832b1231b service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:40.345831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7848038-5ca2-4005-86c1-917832b1231b service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:40.346268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7848038-5ca2-4005-86c1-917832b1231b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:40.348114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e7848038-5ca2-4005-86c1-917832b1231b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:40.408257 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:40.469451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7848038-5ca2-4005-86c1-917832b1231b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:37:40.471264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7848038-5ca2-4005-86c1-917832b1231b service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:37:40.491348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 648/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:37:42.904576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561af6-fe70-4f64-ad56-443105f44c53 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:42.905102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561af6-fe70-4f64-ad56-443105f44c53 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:42.905102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561af6-fe70-4f64-ad56-443105f44c53 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:42.906438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 664/1312] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:37:42.911652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cf068-6394-446c-9fb9-c850b4e6dfe3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:42.912064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cf068-6394-446c-9fb9-c850b4e6dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:42.912330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cf068-6394-446c-9fb9-c850b4e6dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:42.984245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c94cf068-6394-446c-9fb9-c850b4e6dfe3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:37:42.985452 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c94cf068-6394-446c-9fb9-c850b4e6dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:43.084976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 649/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:37:43.123596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561af6-fe70-4f64-ad56-443105f44c53 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:37:43.125120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-24561af6-fe70-4f64-ad56-443105f44c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:43.236983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561af6-fe70-4f64-ad56-443105f44c53 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:37:43.319661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:43.321957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f060e5a-267c-4779-8ebb-1af2756df87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:37:43.323282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f060e5a-267c-4779-8ebb-1af2756df87e service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:43.323575 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f060e5a-267c-4779-8ebb-1af2756df87e service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:43.323858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f060e5a-267c-4779-8ebb-1af2756df87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:43.325537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7f060e5a-267c-4779-8ebb-1af2756df87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:43.436628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f060e5a-267c-4779-8ebb-1af2756df87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:37:43.438109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f060e5a-267c-4779-8ebb-1af2756df87e service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:37:43.456700 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 665/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:37:46.075302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff884-3b08-4adc-a027-88c85d46abba None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:46.075840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff884-3b08-4adc-a027-88c85d46abba None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:46.075840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff884-3b08-4adc-a027-88c85d46abba None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:46.077198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 650/1315] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:37:46.082198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aa8f5-f51a-4083-b63f-0aba3ef96ba4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:46.082577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aa8f5-f51a-4083-b63f-0aba3ef96ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:46.082755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6aa8f5-f51a-4083-b63f-0aba3ef96ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:46.147018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fb6aa8f5-f51a-4083-b63f-0aba3ef96ba4 None None] MFA Rules not processed for user `d7bbfccf210d4e55b6247a1a83e1dc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:37:46.148227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fb6aa8f5-f51a-4083-b63f-0aba3ef96ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:46.199030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:46.243902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 666/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:37:46.284047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff884-3b08-4adc-a027-88c85d46abba None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:37:46.285636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-73eff884-3b08-4adc-a027-88c85d46abba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:46.296085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:46.387531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff884-3b08-4adc-a027-88c85d46abba None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:37:46.460452 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d35e56-1f61-45d3-bdcf-9c011fe0a92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:37:46.461095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35e56-1f61-45d3-bdcf-9c011fe0a92d service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:46.461387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35e56-1f61-45d3-bdcf-9c011fe0a92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:46.461664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35e56-1f61-45d3-bdcf-9c011fe0a92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:46.463328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-70d35e56-1f61-45d3-bdcf-9c011fe0a92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:46.523666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:46.569038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d35e56-1f61-45d3-bdcf-9c011fe0a92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:37:46.570471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d35e56-1f61-45d3-bdcf-9c011fe0a92d service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:37:46.591242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 651/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:37:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:37:49.455494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c640-0e7a-4bc6-bbb6-0ce888764b7e None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:49.456051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c640-0e7a-4bc6-bbb6-0ce888764b7e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:49.456051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752c640-0e7a-4bc6-bbb6-0ce888764b7e None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:49.457441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 667/1318] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:37:49.462678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63994229-44bd-442f-8b23-422ecba442d0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:49.463987 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63994229-44bd-442f-8b23-422ecba442d0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:49.463987 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63994229-44bd-442f-8b23-422ecba442d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:49.527722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-63994229-44bd-442f-8b23-422ecba442d0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:37:49.528918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-63994229-44bd-442f-8b23-422ecba442d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:49.624388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 652/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:37:49.664089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c640-0e7a-4bc6-bbb6-0ce888764b7e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:37:49.665599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5752c640-0e7a-4bc6-bbb6-0ce888764b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:49.767869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752c640-0e7a-4bc6-bbb6-0ce888764b7e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:37:49.840285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f8a1f-359c-4488-b0de-932c0d47f7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:37:49.840926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f8a1f-359c-4488-b0de-932c0d47f7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:49.841213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f8a1f-359c-4488-b0de-932c0d47f7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:49.841491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f8a1f-359c-4488-b0de-932c0d47f7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:49.843156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e61f8a1f-359c-4488-b0de-932c0d47f7f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:49.850382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:49.949966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f8a1f-359c-4488-b0de-932c0d47f7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:37:49.951440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f8a1f-359c-4488-b0de-932c0d47f7f6 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:37:49.969632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 668/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:37:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:37:53.137125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb5d05-ea4f-4e10-84ea-80b2bd7c32aa None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:53.137671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb5d05-ea4f-4e10-84ea-80b2bd7c32aa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:53.137671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb5d05-ea4f-4e10-84ea-80b2bd7c32aa None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:53.139088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 653/1321] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:37:53.144218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94666-8631-4541-a974-700cc95ef0bd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:53.144621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94666-8631-4541-a974-700cc95ef0bd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:53.144830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e94666-8631-4541-a974-700cc95ef0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:53.209501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-78e94666-8631-4541-a974-700cc95ef0bd None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:37:53.210722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-78e94666-8631-4541-a974-700cc95ef0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:53.269288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:53.310896 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 669/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:37:53.359138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f616c-3fe8-4cf9-a444-2e0bcc55e4b1 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:53.359435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f616c-3fe8-4cf9-a444-2e0bcc55e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:53.359719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f616c-3fe8-4cf9-a444-2e0bcc55e4b1 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:53.361095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 654/1323] 10.222.0.42 () {54 vars in 964 bytes} [Fri Jun 24 09:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:37:53.367627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5de5-c8ce-4474-b1e1-9da688b2fa98 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:53.367918 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5de5-c8ce-4474-b1e1-9da688b2fa98 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:53.368199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5de5-c8ce-4474-b1e1-9da688b2fa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:53.451967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-931e5de5-c8ce-4474-b1e1-9da688b2fa98 None None] MFA Rules not processed for user `9b2db60c511f4fd29b772ca5fb014d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:37:53.453127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-931e5de5-c8ce-4474-b1e1-9da688b2fa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:53.532744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 670/1324] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Jun 24 09:37:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:37:53.542601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f616c-3fe8-4cf9-a444-2e0bcc55e4b1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:37:53.544221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-114f616c-3fe8-4cf9-a444-2e0bcc55e4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:53.564174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:53.653463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f616c-3fe8-4cf9-a444-2e0bcc55e4b1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:37:53.727750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28058514-c541-4973-a476-778e7ccdf940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:37:53.728303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058514-c541-4973-a476-778e7ccdf940 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:53.729084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058514-c541-4973-a476-778e7ccdf940 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:53.729365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28058514-c541-4973-a476-778e7ccdf940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:53.731050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-28058514-c541-4973-a476-778e7ccdf940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:53.810620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:53.848210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28058514-c541-4973-a476-778e7ccdf940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:37:53.849653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28058514-c541-4973-a476-778e7ccdf940 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:37:53.870495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 655/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:37:56.192409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56090017-349f-4fb0-b16b-aa0b610fc9a7 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:56.192948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56090017-349f-4fb0-b16b-aa0b610fc9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:56.192948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56090017-349f-4fb0-b16b-aa0b610fc9a7 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:56.194385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 671/1326] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:37:56.200860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389c3c2-0576-4cfb-b372-8425763685b2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:56.201406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389c3c2-0576-4cfb-b372-8425763685b2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:56.201539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389c3c2-0576-4cfb-b372-8425763685b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:56.269003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6389c3c2-0576-4cfb-b372-8425763685b2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:37:56.270246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6389c3c2-0576-4cfb-b372-8425763685b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:56.370259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 656/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:37:56.406944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56090017-349f-4fb0-b16b-aa0b610fc9a7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:37:56.408481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-56090017-349f-4fb0-b16b-aa0b610fc9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:56.470115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:56.513981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56090017-349f-4fb0-b16b-aa0b610fc9a7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:37:56.591910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4282d91-fee2-4f55-a041-c08fc0475a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:37:56.591910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4282d91-fee2-4f55-a041-c08fc0475a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:56.591910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4282d91-fee2-4f55-a041-c08fc0475a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:56.591910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4282d91-fee2-4f55-a041-c08fc0475a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:56.593075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d4282d91-fee2-4f55-a041-c08fc0475a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:56.699216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:56.701541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4282d91-fee2-4f55-a041-c08fc0475a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:37:56.703046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4282d91-fee2-4f55-a041-c08fc0475a2d service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:37:56.721811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 672/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:37:58.818620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead58ac6-c614-4f64-9285-c81bee7f0194 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:58.819162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead58ac6-c614-4f64-9285-c81bee7f0194 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:58.819162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead58ac6-c614-4f64-9285-c81bee7f0194 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:58.820492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 657/1329] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:37:58.826115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3899-2c02-4b4b-ae39-d43cee3e3c12 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:58.826574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3899-2c02-4b4b-ae39-d43cee3e3c12 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:58.826665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed3899-2c02-4b4b-ae39-d43cee3e3c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:58.892944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a2ed3899-2c02-4b4b-ae39-d43cee3e3c12 None None] MFA Rules not processed for user `d7bbfccf210d4e55b6247a1a83e1dc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:37:58.894184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a2ed3899-2c02-4b4b-ae39-d43cee3e3c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:58.996483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 673/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:37:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:37:59.045448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead58ac6-c614-4f64-9285-c81bee7f0194 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:37:59.045448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ead58ac6-c614-4f64-9285-c81bee7f0194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:59.141715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:59.165022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead58ac6-c614-4f64-9285-c81bee7f0194 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:37:59.240258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf7a49-c6ef-4b63-8f4d-7b2c60ab63d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:37:59.240897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf7a49-c6ef-4b63-8f4d-7b2c60ab63d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:37:59.241204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf7a49-c6ef-4b63-8f4d-7b2c60ab63d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:37:59.241481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf7a49-c6ef-4b63-8f4d-7b2c60ab63d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:37:59.243134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-efdf7a49-c6ef-4b63-8f4d-7b2c60ab63d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:37:59.322384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:37:59.354715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf7a49-c6ef-4b63-8f4d-7b2c60ab63d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:37:59.356458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf7a49-c6ef-4b63-8f4d-7b2c60ab63d0 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:37:59.374684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 658/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:37:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:38:01.990249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40c507-728c-4dff-817b-f7989650df2b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:01.990857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40c507-728c-4dff-817b-f7989650df2b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:01.990857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40c507-728c-4dff-817b-f7989650df2b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:01.992226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 674/1332] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:01.998001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4c26-de8e-4f2d-afaf-2f46400833bc None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:01.998387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4c26-de8e-4f2d-afaf-2f46400833bc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:01.998564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef4c26-de8e-4f2d-afaf-2f46400833bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:02.063986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-19ef4c26-de8e-4f2d-afaf-2f46400833bc None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:02.065209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-19ef4c26-de8e-4f2d-afaf-2f46400833bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:02.161840 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 659/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:02.198524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40c507-728c-4dff-817b-f7989650df2b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:02.200125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ad40c507-728c-4dff-817b-f7989650df2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:02.269907 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:02.302092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40c507-728c-4dff-817b-f7989650df2b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:02.373669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e136d-9f41-45d7-9d27-265a8c0845cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:02.374313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e136d-9f41-45d7-9d27-265a8c0845cd service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:02.374597 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e136d-9f41-45d7-9d27-265a8c0845cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:02.374892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e136d-9f41-45d7-9d27-265a8c0845cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:02.376500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d75e136d-9f41-45d7-9d27-265a8c0845cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:02.482036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e136d-9f41-45d7-9d27-265a8c0845cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:02.483499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e136d-9f41-45d7-9d27-265a8c0845cd service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:02.493057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:02.501754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 675/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:04.567980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bbc26-090e-45ec-a454-b47b951982d9 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:04.568540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bbc26-090e-45ec-a454-b47b951982d9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:04.568540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bbc26-090e-45ec-a454-b47b951982d9 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:04.569888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 660/1335] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:04.575038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b970dc5-de68-43c1-85b8-7da217c31518 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:04.575448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b970dc5-de68-43c1-85b8-7da217c31518 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:04.575739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b970dc5-de68-43c1-85b8-7da217c31518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:04.640928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2b970dc5-de68-43c1-85b8-7da217c31518 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:04.644820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2b970dc5-de68-43c1-85b8-7da217c31518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:04.738827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 676/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:04.779380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bbc26-090e-45ec-a454-b47b951982d9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:04.780903 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bf6bbc26-090e-45ec-a454-b47b951982d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:04.820386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:04.883646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bbc26-090e-45ec-a454-b47b951982d9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:04.955298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62151f86-2173-4b81-96ed-beaba81a3f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:04.955941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62151f86-2173-4b81-96ed-beaba81a3f01 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:04.956226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62151f86-2173-4b81-96ed-beaba81a3f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:04.956501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62151f86-2173-4b81-96ed-beaba81a3f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:04.958129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-62151f86-2173-4b81-96ed-beaba81a3f01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:05.041070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:05.066166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62151f86-2173-4b81-96ed-beaba81a3f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:05.067633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62151f86-2173-4b81-96ed-beaba81a3f01 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:05.086659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 661/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:07.674934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c2966-7eee-4d66-85e2-3e3397226b13 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:07.675472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c2966-7eee-4d66-85e2-3e3397226b13 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:07.675573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c2966-7eee-4d66-85e2-3e3397226b13 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:07.676896 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 677/1338] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:07.682307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810449b-c5d9-41fb-bc73-3f30d93e2561 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:07.682724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810449b-c5d9-41fb-bc73-3f30d93e2561 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:07.682892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810449b-c5d9-41fb-bc73-3f30d93e2561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:07.747383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5810449b-c5d9-41fb-bc73-3f30d93e2561 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:07.748576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5810449b-c5d9-41fb-bc73-3f30d93e2561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:07.844960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 662/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:07.881245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c2966-7eee-4d66-85e2-3e3397226b13 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:07.882818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-825c2966-7eee-4d66-85e2-3e3397226b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:07.958686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:07.985572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c2966-7eee-4d66-85e2-3e3397226b13 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:08.058526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff50ec-2cfe-4899-8878-9f18784841eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:08.059199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff50ec-2cfe-4899-8878-9f18784841eb service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:08.059483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff50ec-2cfe-4899-8878-9f18784841eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:08.059757 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff50ec-2cfe-4899-8878-9f18784841eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:08.061384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-45ff50ec-2cfe-4899-8878-9f18784841eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:08.167278 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff50ec-2cfe-4899-8878-9f18784841eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:08.168660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff50ec-2cfe-4899-8878-9f18784841eb service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:08.187120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 678/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:12.563147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8868551-d5d5-439b-a6ce-db1e73ca66b7 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:12.563720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8868551-d5d5-439b-a6ce-db1e73ca66b7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:12.563720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8868551-d5d5-439b-a6ce-db1e73ca66b7 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:12.565234 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 663/1341] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:12.570527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b1a42-5028-45f3-a97e-f041f0616420 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:12.571004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b1a42-5028-45f3-a97e-f041f0616420 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:12.571146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b1a42-5028-45f3-a97e-f041f0616420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:12.580346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:12.651813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-af9b1a42-5028-45f3-a97e-f041f0616420 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:12.653040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-af9b1a42-5028-45f3-a97e-f041f0616420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:12.759055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 679/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:12.799644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8868551-d5d5-439b-a6ce-db1e73ca66b7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:12.801929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e8868551-d5d5-439b-a6ce-db1e73ca66b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:12.852563 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:12.899441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8868551-d5d5-439b-a6ce-db1e73ca66b7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:12.904089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87034d-a1fd-42f3-aa7b-f4aa34921c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:12.904740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87034d-a1fd-42f3-aa7b-f4aa34921c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:12.905026 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87034d-a1fd-42f3-aa7b-f4aa34921c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:12.905304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87034d-a1fd-42f3-aa7b-f4aa34921c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:12.914864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87034d-a1fd-42f3-aa7b-f4aa34921c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:12.916448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87034d-a1fd-42f3-aa7b-f4aa34921c2f service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:12.925973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 664/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:15.967482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb593151-344d-425a-8632-3d9838aa2a65 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:15.968039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb593151-344d-425a-8632-3d9838aa2a65 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:15.968039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb593151-344d-425a-8632-3d9838aa2a65 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:15.969422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 680/1344] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:15.974706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a256-68fa-44da-a5d3-d08cdad0ccfc None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:15.975147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a256-68fa-44da-a5d3-d08cdad0ccfc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:15.975305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069a256-68fa-44da-a5d3-d08cdad0ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:16.004147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6069a256-68fa-44da-a5d3-d08cdad0ccfc None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:16.005347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6069a256-68fa-44da-a5d3-d08cdad0ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:16.084605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 665/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:16.122566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb593151-344d-425a-8632-3d9838aa2a65 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:16.124309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eb593151-344d-425a-8632-3d9838aa2a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:16.137604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb593151-344d-425a-8632-3d9838aa2a65 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:16.143349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e77eeb-7801-4e4a-9b74-0512242756c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:16.143994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77eeb-7801-4e4a-9b74-0512242756c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:16.146065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77eeb-7801-4e4a-9b74-0512242756c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:16.146357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e77eeb-7801-4e4a-9b74-0512242756c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:16.158082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e77eeb-7801-4e4a-9b74-0512242756c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:16.159501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e77eeb-7801-4e4a-9b74-0512242756c1 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:16.169350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 681/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:38:21.039464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199dcfc-4a7d-4cfb-b326-9851d2590b9b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:21.039988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199dcfc-4a7d-4cfb-b326-9851d2590b9b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:21.040098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199dcfc-4a7d-4cfb-b326-9851d2590b9b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:21.041837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 666/1347] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:21.047523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebda56-f590-4097-8c2e-c609555d9253 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:21.048014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebda56-f590-4097-8c2e-c609555d9253 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:21.048253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebda56-f590-4097-8c2e-c609555d9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:21.066836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8bebda56-f590-4097-8c2e-c609555d9253 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:21.068068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8bebda56-f590-4097-8c2e-c609555d9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:21.077350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 682/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:21.117243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199dcfc-4a7d-4cfb-b326-9851d2590b9b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:21.129085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199dcfc-4a7d-4cfb-b326-9851d2590b9b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:21.132743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31770b1-4f88-4001-ab8b-ecc9465b9e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:21.133378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31770b1-4f88-4001-ab8b-ecc9465b9e18 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:21.133660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31770b1-4f88-4001-ab8b-ecc9465b9e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:21.133934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31770b1-4f88-4001-ab8b-ecc9465b9e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:21.144155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31770b1-4f88-4001-ab8b-ecc9465b9e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:21.145589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31770b1-4f88-4001-ab8b-ecc9465b9e18 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:21.158080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 667/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:26.148948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1597f-f041-4fe7-ac96-70a53b054594 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:26.149705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1597f-f041-4fe7-ac96-70a53b054594 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:26.153691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1597f-f041-4fe7-ac96-70a53b054594 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:26.157679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 683/1350] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:38:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:26.164785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb41a-93ce-4054-b92c-59824c91504f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:26.165280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb41a-93ce-4054-b92c-59824c91504f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:26.165361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccb41a-93ce-4054-b92c-59824c91504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:26.267207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4eccb41a-93ce-4054-b92c-59824c91504f None None] MFA Rules not processed for user `87fd5580ed264a08a3ad31850e0a53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:26.268675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4eccb41a-93ce-4054-b92c-59824c91504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:26.305183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:26.357230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 668/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:38:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:30.661254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d69a-6246-4314-bf09-4aa695b942df None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:30.661254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d69a-6246-4314-bf09-4aa695b942df None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:30.661254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975d69a-6246-4314-bf09-4aa695b942df None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:30.661254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 684/1352] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:30.662033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d356f-44de-4fe7-8ce7-ee8ac0b63d83 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:30.662033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d356f-44de-4fe7-8ce7-ee8ac0b63d83 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:30.662033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d356f-44de-4fe7-8ce7-ee8ac0b63d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:30.676593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-af3d356f-44de-4fe7-8ce7-ee8ac0b63d83 None None] MFA Rules not processed for user `87fd5580ed264a08a3ad31850e0a53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:30.677872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-af3d356f-44de-4fe7-8ce7-ee8ac0b63d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:30.687629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 669/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:31.061116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=72 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:32.101308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed86c08-920c-41db-838b-d53daead681e None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:32.101948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed86c08-920c-41db-838b-d53daead681e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:32.101948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed86c08-920c-41db-838b-d53daead681e None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:32.103871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 685/1354] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:32.109254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826924-eb88-49a9-89e3-77ed258b4325 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:32.109695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826924-eb88-49a9-89e3-77ed258b4325 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:32.109806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826924-eb88-49a9-89e3-77ed258b4325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:32.129948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fb826924-eb88-49a9-89e3-77ed258b4325 None None] MFA Rules not processed for user `87fd5580ed264a08a3ad31850e0a53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:32.131191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fb826924-eb88-49a9-89e3-77ed258b4325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:32.140212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 670/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:35.876220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cada24b-a798-4e94-b01b-90839a293fec None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:35.876709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cada24b-a798-4e94-b01b-90839a293fec None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:35.876709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cada24b-a798-4e94-b01b-90839a293fec None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:35.879260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 686/1356] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:35.883612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08164c-8572-4c36-8c49-49b6e16e5e7f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:35.884594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08164c-8572-4c36-8c49-49b6e16e5e7f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:35.885599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08164c-8572-4c36-8c49-49b6e16e5e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:35.907788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1e08164c-8572-4c36-8c49-49b6e16e5e7f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:35.909465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1e08164c-8572-4c36-8c49-49b6e16e5e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:35.924442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 671/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:35.974118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3515c-2625-46fe-88dc-bf64719f56a4 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:35.974410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3515c-2625-46fe-88dc-bf64719f56a4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:35.974685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3515c-2625-46fe-88dc-bf64719f56a4 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:35.976497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 687/1358] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 09:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:35.985484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2622c-6d5d-43af-b3c1-3d90c3b826a7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:35.986488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2622c-6d5d-43af-b3c1-3d90c3b826a7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:35.987149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2622c-6d5d-43af-b3c1-3d90c3b826a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:36.043872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-49b2622c-6d5d-43af-b3c1-3d90c3b826a7 None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:36.045652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-49b2622c-6d5d-43af-b3c1-3d90c3b826a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:36.140108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 672/1359] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 09:38:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:36.147633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3515c-2625-46fe-88dc-bf64719f56a4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:36.163093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3515c-2625-46fe-88dc-bf64719f56a4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:36.169379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394f5ae-a83f-4bd2-9f18-70ae21c16ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:36.170122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f5ae-a83f-4bd2-9f18-70ae21c16ed2 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:36.170478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f5ae-a83f-4bd2-9f18-70ae21c16ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:36.170953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394f5ae-a83f-4bd2-9f18-70ae21c16ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:36.180239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394f5ae-a83f-4bd2-9f18-70ae21c16ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:36.182948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e394f5ae-a83f-4bd2-9f18-70ae21c16ed2 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:36.198231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 688/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:38.468452 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d556d8-6024-4cf3-80bd-fbdf6d30b591 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:38.469012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d556d8-6024-4cf3-80bd-fbdf6d30b591 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:38.469012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d556d8-6024-4cf3-80bd-fbdf6d30b591 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:38.470504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 673/1361] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:38.475727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572458b8-5cf7-42f1-a0cb-3c1064185357 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:38.476141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572458b8-5cf7-42f1-a0cb-3c1064185357 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:38.476282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572458b8-5cf7-42f1-a0cb-3c1064185357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:38.494958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-572458b8-5cf7-42f1-a0cb-3c1064185357 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:38.496406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-572458b8-5cf7-42f1-a0cb-3c1064185357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:38.504731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 689/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:38.551191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d556d8-6024-4cf3-80bd-fbdf6d30b591 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:38.566659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d556d8-6024-4cf3-80bd-fbdf6d30b591 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:38.572433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbee946-515d-4623-8817-05620d6919fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:38.572898 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbee946-515d-4623-8817-05620d6919fc service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:38.573102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbee946-515d-4623-8817-05620d6919fc service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:38.573376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbee946-515d-4623-8817-05620d6919fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:38.582125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbee946-515d-4623-8817-05620d6919fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:38.583755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbee946-515d-4623-8817-05620d6919fc service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:38.597740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 674/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:41.106627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff1bf-39b4-436d-8afb-6334ab28525a None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:41.107128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff1bf-39b4-436d-8afb-6334ab28525a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:41.107128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceff1bf-39b4-436d-8afb-6334ab28525a None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:41.108846 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 690/1364] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:41.113960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0d14b-a03c-4439-a7ee-c9a74fcd78ca None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:41.114784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0d14b-a03c-4439-a7ee-c9a74fcd78ca None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:41.115391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0d14b-a03c-4439-a7ee-c9a74fcd78ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:41.136147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e1b0d14b-a03c-4439-a7ee-c9a74fcd78ca None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:41.137371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e1b0d14b-a03c-4439-a7ee-c9a74fcd78ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:41.154943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 675/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:41.195567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f2f10-3625-431e-afe1-56b2bf4ec739 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:41.195762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f2f10-3625-431e-afe1-56b2bf4ec739 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:41.196023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f2f10-3625-431e-afe1-56b2bf4ec739 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:41.198061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 691/1366] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 09:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:41.203931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9484a-eb27-473c-bbfc-ec99aa8c3076 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:41.204221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9484a-eb27-473c-bbfc-ec99aa8c3076 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:41.205651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9484a-eb27-473c-bbfc-ec99aa8c3076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:41.222747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-88a9484a-eb27-473c-bbfc-ec99aa8c3076 None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:41.223981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-88a9484a-eb27-473c-bbfc-ec99aa8c3076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:41.233809 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 676/1367] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 09:38:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:41.241491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f2f10-3625-431e-afe1-56b2bf4ec739 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:41.256895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f2f10-3625-431e-afe1-56b2bf4ec739 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:41.263631 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8d5a7-6a2e-4bf4-9811-5c4fc2fc4f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:41.264274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8d5a7-6a2e-4bf4-9811-5c4fc2fc4f4d service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:41.264563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8d5a7-6a2e-4bf4-9811-5c4fc2fc4f4d service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:41.264842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8d5a7-6a2e-4bf4-9811-5c4fc2fc4f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:41.273107 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8d5a7-6a2e-4bf4-9811-5c4fc2fc4f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:41.274704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8d5a7-6a2e-4bf4-9811-5c4fc2fc4f4d service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:41.284416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 692/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:43.591599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bead160-2723-4780-abc0-264b59d4748a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:43.592470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bead160-2723-4780-abc0-264b59d4748a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:43.592927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bead160-2723-4780-abc0-264b59d4748a None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:43.594772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 677/1369] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:43.599804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276baa-97e2-47ba-aef5-6decd9a94f4a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:43.600221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276baa-97e2-47ba-aef5-6decd9a94f4a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:43.600441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276baa-97e2-47ba-aef5-6decd9a94f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:43.620582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-92276baa-97e2-47ba-aef5-6decd9a94f4a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:43.622525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-92276baa-97e2-47ba-aef5-6decd9a94f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:43.631092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 693/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:43.676116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bead160-2723-4780-abc0-264b59d4748a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:43.691949 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bead160-2723-4780-abc0-264b59d4748a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:43.698410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e8073-508f-417f-b45d-03a3e976b901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:43.699166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8073-508f-417f-b45d-03a3e976b901 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:43.699575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8073-508f-417f-b45d-03a3e976b901 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:43.699933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8073-508f-417f-b45d-03a3e976b901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:43.709061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e8073-508f-417f-b45d-03a3e976b901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:43.710729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e8073-508f-417f-b45d-03a3e976b901 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:43.720971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 678/1371] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:44.205874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac539fa2-d15a-455f-bbd6-026ecba30bfe None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:44.206825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac539fa2-d15a-455f-bbd6-026ecba30bfe None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:44.207581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac539fa2-d15a-455f-bbd6-026ecba30bfe None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:44.209248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 694/1372] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:44.215347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea99aa-0df9-49ee-b403-184c11b68f40 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:44.215891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea99aa-0df9-49ee-b403-184c11b68f40 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:44.216406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea99aa-0df9-49ee-b403-184c11b68f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:44.237360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-99ea99aa-0df9-49ee-b403-184c11b68f40 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:44.239188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-99ea99aa-0df9-49ee-b403-184c11b68f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:44.249571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 679/1373] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:44.612802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77573987-9a76-412f-8ca7-269c19d3b382 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:44.612802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77573987-9a76-412f-8ca7-269c19d3b382 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:44.612802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77573987-9a76-412f-8ca7-269c19d3b382 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:44.612802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 695/1374] 10.222.0.42 () {54 vars in 963 bytes} [Fri Jun 24 09:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:44.618546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff713a-175e-485e-bd7d-324f8df1afe4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:44.620011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff713a-175e-485e-bd7d-324f8df1afe4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:44.620534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff713a-175e-485e-bd7d-324f8df1afe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:44.628548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:38:44.692309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4dff713a-175e-485e-bd7d-324f8df1afe4 None None] MFA Rules not processed for user `ee91a24eb66d4753bc6a81d278b1088f`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:44.694459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4dff713a-175e-485e-bd7d-324f8df1afe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:44.765606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 680/1375] 10.222.0.42 () {58 vars in 1060 bytes} [Fri Jun 24 09:38:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:38:44.772990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77573987-9a76-412f-8ca7-269c19d3b382 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:44.785316 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77573987-9a76-412f-8ca7-269c19d3b382 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:44.790027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75f24b-54fd-4292-9c3a-c998cdc9821f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:44.791503 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75f24b-54fd-4292-9c3a-c998cdc9821f service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:44.792193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75f24b-54fd-4292-9c3a-c998cdc9821f service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:44.792696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75f24b-54fd-4292-9c3a-c998cdc9821f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:44.803478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75f24b-54fd-4292-9c3a-c998cdc9821f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:44.805377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75f24b-54fd-4292-9c3a-c998cdc9821f service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:44.818038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 696/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:45.942127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23848e-58ff-47f0-8da8-bd821251188f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:45.942693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23848e-58ff-47f0-8da8-bd821251188f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:45.942786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23848e-58ff-47f0-8da8-bd821251188f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:45.944173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 681/1377] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:45.950607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0d2a-ba8a-4440-aa1c-cac33d8090a9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:45.951022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0d2a-ba8a-4440-aa1c-cac33d8090a9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:45.951210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0d2a-ba8a-4440-aa1c-cac33d8090a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:45.969961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f57f0d2a-ba8a-4440-aa1c-cac33d8090a9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:45.971180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f57f0d2a-ba8a-4440-aa1c-cac33d8090a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:45.979926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 697/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:46.024490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23848e-58ff-47f0-8da8-bd821251188f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:46.039097 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23848e-58ff-47f0-8da8-bd821251188f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:46.045460 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaded8-24f6-4551-bddd-722cb17dba77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:46.046088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaded8-24f6-4551-bddd-722cb17dba77 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:46.046371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaded8-24f6-4551-bddd-722cb17dba77 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:46.046644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaded8-24f6-4551-bddd-722cb17dba77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:46.055151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaded8-24f6-4551-bddd-722cb17dba77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:46.057504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbaded8-24f6-4551-bddd-722cb17dba77 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:46.066953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 682/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:48.300452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc70cdb-7fbc-4026-9a9d-d4129bd034e4 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:48.300961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc70cdb-7fbc-4026-9a9d-d4129bd034e4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:48.301055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc70cdb-7fbc-4026-9a9d-d4129bd034e4 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:48.302415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 698/1380] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:48.307779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ec2ce-7798-4571-91e2-8082a5e4729a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:48.308192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ec2ce-7798-4571-91e2-8082a5e4729a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:48.308373 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ec2ce-7798-4571-91e2-8082a5e4729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:48.326994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2e1ec2ce-7798-4571-91e2-8082a5e4729a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:48.328205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2e1ec2ce-7798-4571-91e2-8082a5e4729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:48.336083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 683/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:48.382316 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc70cdb-7fbc-4026-9a9d-d4129bd034e4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:48.397330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc70cdb-7fbc-4026-9a9d-d4129bd034e4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:48.404790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903e11e-4d5d-464d-b8eb-32d5b1b38a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:48.405172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e11e-4d5d-464d-b8eb-32d5b1b38a16 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:48.405461 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e11e-4d5d-464d-b8eb-32d5b1b38a16 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:48.405738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903e11e-4d5d-464d-b8eb-32d5b1b38a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:48.417418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903e11e-4d5d-464d-b8eb-32d5b1b38a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:48.419218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903e11e-4d5d-464d-b8eb-32d5b1b38a16 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:48.428913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 699/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:50.646416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de551c-8fdf-4dff-baa6-d827e880f76d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:50.647069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de551c-8fdf-4dff-baa6-d827e880f76d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:50.647069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de551c-8fdf-4dff-baa6-d827e880f76d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:50.649144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 684/1383] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:50.654551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f4683-dd1f-48d9-ab95-96b1d6eaa32c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:50.655028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f4683-dd1f-48d9-ab95-96b1d6eaa32c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:50.657948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f4683-dd1f-48d9-ab95-96b1d6eaa32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:50.674365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bb5f4683-dd1f-48d9-ab95-96b1d6eaa32c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:50.675608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bb5f4683-dd1f-48d9-ab95-96b1d6eaa32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:50.684223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 700/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:50.731333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de551c-8fdf-4dff-baa6-d827e880f76d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:50.746954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de551c-8fdf-4dff-baa6-d827e880f76d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:50.753042 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ce30d-0452-41f0-98af-3ab865e58bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:50.753685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ce30d-0452-41f0-98af-3ab865e58bd2 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:50.753967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ce30d-0452-41f0-98af-3ab865e58bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:50.754244 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ce30d-0452-41f0-98af-3ab865e58bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:50.763502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ce30d-0452-41f0-98af-3ab865e58bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:50.765187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ce30d-0452-41f0-98af-3ab865e58bd2 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:50.775667 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 685/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:52.847053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990586-120b-4485-a3c9-12480d0efd67 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:52.847629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990586-120b-4485-a3c9-12480d0efd67 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:52.847629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4990586-120b-4485-a3c9-12480d0efd67 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:52.849015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 701/1386] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:52.855302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bcf3f-cfc3-46d3-a0ba-dc460cc46afa None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:52.855732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bcf3f-cfc3-46d3-a0ba-dc460cc46afa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:52.855931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bcf3f-cfc3-46d3-a0ba-dc460cc46afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:52.876105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-559bcf3f-cfc3-46d3-a0ba-dc460cc46afa None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:52.877450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-559bcf3f-cfc3-46d3-a0ba-dc460cc46afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:52.886739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 686/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:52.932309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4990586-120b-4485-a3c9-12480d0efd67 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:52.948576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4990586-120b-4485-a3c9-12480d0efd67 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:52.954552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb64a3d-b9d9-4387-922d-ff384163c0b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:52.955296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb64a3d-b9d9-4387-922d-ff384163c0b4 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:52.955621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb64a3d-b9d9-4387-922d-ff384163c0b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:52.955938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb64a3d-b9d9-4387-922d-ff384163c0b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:52.965974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb64a3d-b9d9-4387-922d-ff384163c0b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:52.967812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb64a3d-b9d9-4387-922d-ff384163c0b4 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:52.978498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 702/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:55.224458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0f1ba-8e7c-44aa-b8b0-817fc2067f83 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:55.225177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0f1ba-8e7c-44aa-b8b0-817fc2067f83 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:55.225177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0f1ba-8e7c-44aa-b8b0-817fc2067f83 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:55.226436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 687/1389] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:55.232267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a056a1-3623-407e-9329-5d080975d5fe None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:55.232714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a056a1-3623-407e-9329-5d080975d5fe None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:55.232825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a056a1-3623-407e-9329-5d080975d5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:55.252102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-19a056a1-3623-407e-9329-5d080975d5fe None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:55.253315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-19a056a1-3623-407e-9329-5d080975d5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:55.261598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 703/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:55.308131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0f1ba-8e7c-44aa-b8b0-817fc2067f83 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:55.322370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0f1ba-8e7c-44aa-b8b0-817fc2067f83 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:55.328410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad0b19-41dd-4cb7-935e-ff4a8a82fb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:55.329050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad0b19-41dd-4cb7-935e-ff4a8a82fb90 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:55.329336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad0b19-41dd-4cb7-935e-ff4a8a82fb90 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:55.329617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad0b19-41dd-4cb7-935e-ff4a8a82fb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:55.338593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad0b19-41dd-4cb7-935e-ff4a8a82fb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:55.340248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad0b19-41dd-4cb7-935e-ff4a8a82fb90 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:55.349714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 688/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:38:57.701703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b842f2-5534-4d3f-888a-18e90efe4630 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:57.702265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b842f2-5534-4d3f-888a-18e90efe4630 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:57.702370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b842f2-5534-4d3f-888a-18e90efe4630 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:57.703924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 704/1392] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:38:57.709480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2170c3e-9039-49b1-938a-20847210a874 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:57.709935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2170c3e-9039-49b1-938a-20847210a874 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:57.710036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2170c3e-9039-49b1-938a-20847210a874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:57.729258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f2170c3e-9039-49b1-938a-20847210a874 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:38:57.730475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f2170c3e-9039-49b1-938a-20847210a874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:38:57.740002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 689/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:38:57.798264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b842f2-5534-4d3f-888a-18e90efe4630 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:38:57.814011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b842f2-5534-4d3f-888a-18e90efe4630 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:38:57.819991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da63f04-6d13-4f0b-8a72-8dbb8705e00c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:38:57.820680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da63f04-6d13-4f0b-8a72-8dbb8705e00c service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:38:57.821026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da63f04-6d13-4f0b-8a72-8dbb8705e00c service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:38:57.821369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da63f04-6d13-4f0b-8a72-8dbb8705e00c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:38:57.830740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da63f04-6d13-4f0b-8a72-8dbb8705e00c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:38:57.832605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da63f04-6d13-4f0b-8a72-8dbb8705e00c service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:38:57.844833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 705/1394] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:00.069911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03ae3-6c0e-44f2-a787-53e0b77b4ca4 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:00.070454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03ae3-6c0e-44f2-a787-53e0b77b4ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:00.070454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03ae3-6c0e-44f2-a787-53e0b77b4ca4 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:00.071878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 690/1395] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:00.077121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a59e-4258-4b36-b9a1-6a6373211fcf None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:00.077524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a59e-4258-4b36-b9a1-6a6373211fcf None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:00.077685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74a59e-4258-4b36-b9a1-6a6373211fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:00.095632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4f74a59e-4258-4b36-b9a1-6a6373211fcf None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:00.096837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4f74a59e-4258-4b36-b9a1-6a6373211fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:00.105256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 706/1396] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:00.148890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03ae3-6c0e-44f2-a787-53e0b77b4ca4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:00.163739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03ae3-6c0e-44f2-a787-53e0b77b4ca4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:00.169565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326a61a-757b-4170-8708-a039c32b34fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:00.170205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326a61a-757b-4170-8708-a039c32b34fb service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:00.170489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326a61a-757b-4170-8708-a039c32b34fb service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:00.170770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326a61a-757b-4170-8708-a039c32b34fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:00.179122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326a61a-757b-4170-8708-a039c32b34fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:00.180706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326a61a-757b-4170-8708-a039c32b34fb service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:00.190826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 691/1397] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:00.515688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bde595-0dab-4ceb-84f9-1766d1afd75f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:00.515881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bde595-0dab-4ceb-84f9-1766d1afd75f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:00.516165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bde595-0dab-4ceb-84f9-1766d1afd75f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:00.517587 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 707/1398] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:00.523159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a57f-73b2-4149-91e2-279333afdadf None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:00.523445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a57f-73b2-4149-91e2-279333afdadf None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:00.523720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7a57f-73b2-4149-91e2-279333afdadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:00.542550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b7a7a57f-73b2-4149-91e2-279333afdadf None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:00.543778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b7a7a57f-73b2-4149-91e2-279333afdadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:00.551586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 692/1399] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:00.607974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce146-bc82-45ca-a5b7-de968a609003 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:00.608340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce146-bc82-45ca-a5b7-de968a609003 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:00.608686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ce146-bc82-45ca-a5b7-de968a609003 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:00.610200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 708/1400] 10.222.0.42 () {54 vars in 962 bytes} [Fri Jun 24 09:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:00.615292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f0193-deba-4e7f-8eb6-7a30f6c923bf None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:00.615590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f0193-deba-4e7f-8eb6-7a30f6c923bf None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:00.615878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f0193-deba-4e7f-8eb6-7a30f6c923bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:00.666532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-db0f0193-deba-4e7f-8eb6-7a30f6c923bf None None] MFA Rules not processed for user `d0a8a5a1bc174acd9b13477c7d4b4a07`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:00.667863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-db0f0193-deba-4e7f-8eb6-7a30f6c923bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:00.703451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:00.732136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 693/1401] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Jun 24 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:00.739909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce146-bc82-45ca-a5b7-de968a609003 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:00.751729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ce146-bc82-45ca-a5b7-de968a609003 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:00.755338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80da56-4c0f-43a8-b5c5-30c67d7300c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0a8a5a1bc174acd9b13477c7d4b4a07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:00.756041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80da56-4c0f-43a8-b5c5-30c67d7300c5 service glance] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:00.756368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80da56-4c0f-43a8-b5c5-30c67d7300c5 service glance] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:00.756665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80da56-4c0f-43a8-b5c5-30c67d7300c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:00.766739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80da56-4c0f-43a8-b5c5-30c67d7300c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:00.768207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80da56-4c0f-43a8-b5c5-30c67d7300c5 service glance] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:00.777768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 709/1402] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:01.687573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9438d39-3290-4869-9348-e2786269dbe3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:01.689224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9438d39-3290-4869-9348-e2786269dbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:01.689224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9438d39-3290-4869-9348-e2786269dbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:01.739288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e9438d39-3290-4869-9348-e2786269dbe3 None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:01.740521 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e9438d39-3290-4869-9348-e2786269dbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:01.805136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 694/1403] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:39:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:01.847377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc110-383f-4745-b62f-e4add0c92318 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:01.847872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc110-383f-4745-b62f-e4add0c92318 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:01.848071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adc110-383f-4745-b62f-e4add0c92318 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:01.849582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 710/1404] 10.222.0.42 () {54 vars in 942 bytes} [Fri Jun 24 09:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:01.856095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871538c0-c7fd-472c-9049-4129d9687303 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:01.856454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871538c0-c7fd-472c-9049-4129d9687303 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:01.856800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871538c0-c7fd-472c-9049-4129d9687303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:01.906689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-871538c0-c7fd-472c-9049-4129d9687303 None None] MFA Rules not processed for user `25606976e6fe4daf9a552368088cdef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:01.907948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-871538c0-c7fd-472c-9049-4129d9687303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:01.981690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 695/1405] 10.222.0.42 () {58 vars in 1039 bytes} [Fri Jun 24 09:39:01 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:39:01.991098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adc110-383f-4745-b62f-e4add0c92318 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:01.998996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=61 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:02.005496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adc110-383f-4745-b62f-e4add0c92318 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:02.011732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff71023-6b38-43cf-aec2-17a113c846de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:02.012387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71023-6b38-43cf-aec2-17a113c846de service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:02.012674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71023-6b38-43cf-aec2-17a113c846de service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:02.012955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff71023-6b38-43cf-aec2-17a113c846de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:02.021492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff71023-6b38-43cf-aec2-17a113c846de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:02.023099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff71023-6b38-43cf-aec2-17a113c846de service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:02.031853 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 711/1406] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:39:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:39:02.412196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78652b-5c51-4f75-ae29-382661c8a5de None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:02.412735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78652b-5c51-4f75-ae29-382661c8a5de None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:02.413228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78652b-5c51-4f75-ae29-382661c8a5de None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:02.416620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 696/1407] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:39:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:02.421716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2df87-13ac-4797-86cb-0792f78a3868 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:02.422020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2df87-13ac-4797-86cb-0792f78a3868 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:02.422352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2df87-13ac-4797-86cb-0792f78a3868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:02.440269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-18e2df87-13ac-4797-86cb-0792f78a3868 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:02.445139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-18e2df87-13ac-4797-86cb-0792f78a3868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:02.449726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 712/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:02.495305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78652b-5c51-4f75-ae29-382661c8a5de None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:02.510696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78652b-5c51-4f75-ae29-382661c8a5de None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:02.516275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8568586-f28e-4259-a54e-63421582c36c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:02.516915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8568586-f28e-4259-a54e-63421582c36c service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:02.517202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8568586-f28e-4259-a54e-63421582c36c service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:02.517484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8568586-f28e-4259-a54e-63421582c36c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:02.526481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8568586-f28e-4259-a54e-63421582c36c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:02.528105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8568586-f28e-4259-a54e-63421582c36c service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:02.533119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:02.537947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 697/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:12.434866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=8 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:25.868515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331efe0b-3712-4a4d-8436-18243902cb8a None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:25.869218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331efe0b-3712-4a4d-8436-18243902cb8a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:25.869218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331efe0b-3712-4a4d-8436-18243902cb8a None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:25.870518 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 713/1410] 10.222.0.42 () {54 vars in 918 bytes} [Fri Jun 24 09:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:25.875974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b65e1-356e-48f1-bf21-95456cb840f8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:25.876365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b65e1-356e-48f1-bf21-95456cb840f8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:25.876528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b65e1-356e-48f1-bf21-95456cb840f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:25.894805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-537b65e1-356e-48f1-bf21-95456cb840f8 None None] MFA Rules not processed for user `87fd5580ed264a08a3ad31850e0a53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:25.896030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-537b65e1-356e-48f1-bf21-95456cb840f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:25.905180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 698/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Jun 24 09:39:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:25.919131 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f584a8-81d0-44b0-960b-0bd34c17b192 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:25.919423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f584a8-81d0-44b0-960b-0bd34c17b192 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:25.919703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f584a8-81d0-44b0-960b-0bd34c17b192 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:25.921055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 714/1412] 10.222.0.42 () {54 vars in 918 bytes} [Fri Jun 24 09:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:25.925523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f495b-8395-4551-90af-77020c56009d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:25.925814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f495b-8395-4551-90af-77020c56009d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:25.926093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f495b-8395-4551-90af-77020c56009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:25.943513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ce8f495b-8395-4551-90af-77020c56009d None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:25.944698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ce8f495b-8395-4551-90af-77020c56009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:25.954557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 699/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Jun 24 09:39:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:28.473701 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3803696-d064-41bc-9eaa-d70d0ab3b421 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:28.474254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3803696-d064-41bc-9eaa-d70d0ab3b421 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:28.474254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3803696-d064-41bc-9eaa-d70d0ab3b421 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:28.475673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:28.481321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a17b0-4a91-45bd-988a-4bda9987b493 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:28.481720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a17b0-4a91-45bd-988a-4bda9987b493 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:28.481880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a17b0-4a91-45bd-988a-4bda9987b493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:28.500082 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-297a17b0-4a91-45bd-988a-4bda9987b493 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:28.501263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-297a17b0-4a91-45bd-988a-4bda9987b493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:28.509010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:28.552143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3803696-d064-41bc-9eaa-d70d0ab3b421 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:28.567657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3803696-d064-41bc-9eaa-d70d0ab3b421 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:28.574065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aed41-0a78-4c7e-a826-f54e417496e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:28.574726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aed41-0a78-4c7e-a826-f54e417496e0 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:28.575043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aed41-0a78-4c7e-a826-f54e417496e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:28.575327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aed41-0a78-4c7e-a826-f54e417496e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:28.583936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aed41-0a78-4c7e-a826-f54e417496e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:28.585578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aed41-0a78-4c7e-a826-f54e417496e0 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:28.595596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 716/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:29.492189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790377d-5849-4d42-a55d-5393eb37e857 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:29.492729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790377d-5849-4d42-a55d-5393eb37e857 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:29.492729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790377d-5849-4d42-a55d-5393eb37e857 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:29.494193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:29.499563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d525b2-b564-47f4-96d5-618fe979b896 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:29.499983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d525b2-b564-47f4-96d5-618fe979b896 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:29.500132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d525b2-b564-47f4-96d5-618fe979b896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:29.518259 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d7d525b2-b564-47f4-96d5-618fe979b896 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:29.519480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d7d525b2-b564-47f4-96d5-618fe979b896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:29.527916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:29.676466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790377d-5849-4d42-a55d-5393eb37e857 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:29.690355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790377d-5849-4d42-a55d-5393eb37e857 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:29.701590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5335d-1334-4cb7-ab12-ed93e53e59a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:29.701590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5335d-1334-4cb7-ab12-ed93e53e59a2 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:29.701590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5335d-1334-4cb7-ab12-ed93e53e59a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:29.701590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5335d-1334-4cb7-ab12-ed93e53e59a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:29.706513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5335d-1334-4cb7-ab12-ed93e53e59a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:29.708180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5335d-1334-4cb7-ab12-ed93e53e59a2 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:29.718510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 702/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:30.587909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976d0c8-6bc5-4be5-ace4-30774462af0e None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:30.588479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976d0c8-6bc5-4be5-ace4-30774462af0e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:30.588479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976d0c8-6bc5-4be5-ace4-30774462af0e None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:30.589903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:30.595149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45234fc8-4bb7-40a8-8b9f-bad6e3174be9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:30.595518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45234fc8-4bb7-40a8-8b9f-bad6e3174be9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:30.595706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45234fc8-4bb7-40a8-8b9f-bad6e3174be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:30.614118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-45234fc8-4bb7-40a8-8b9f-bad6e3174be9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:30.615326 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-45234fc8-4bb7-40a8-8b9f-bad6e3174be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:30.623974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:39:30.776870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976d0c8-6bc5-4be5-ace4-30774462af0e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:30.791937 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976d0c8-6bc5-4be5-ace4-30774462af0e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:30.797268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763fcd6-062b-4f41-a738-d46a850fd319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:30.797896 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763fcd6-062b-4f41-a738-d46a850fd319 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:30.801629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763fcd6-062b-4f41-a738-d46a850fd319 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:30.801629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763fcd6-062b-4f41-a738-d46a850fd319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:30.807047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763fcd6-062b-4f41-a738-d46a850fd319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:30.808624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763fcd6-062b-4f41-a738-d46a850fd319 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:30.818182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 719/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:39:31.687911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e39e-b539-4dbe-89c1-70f2fb176243 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:31.688464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e39e-b539-4dbe-89c1-70f2fb176243 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:31.688464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e39e-b539-4dbe-89c1-70f2fb176243 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:31.689874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:31.694779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2b974-3664-4dd0-b31a-7f1755fc1bea None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:31.695203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2b974-3664-4dd0-b31a-7f1755fc1bea None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:31.695380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2b974-3664-4dd0-b31a-7f1755fc1bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:31.713478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-94d2b974-3664-4dd0-b31a-7f1755fc1bea None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:31.714671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-94d2b974-3664-4dd0-b31a-7f1755fc1bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:31.722340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:31.874249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e39e-b539-4dbe-89c1-70f2fb176243 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:31.888989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e39e-b539-4dbe-89c1-70f2fb176243 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:31.894465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c414f4-3ca0-4b1d-8746-2e2a530b245a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:31.895130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c414f4-3ca0-4b1d-8746-2e2a530b245a service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:31.895418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c414f4-3ca0-4b1d-8746-2e2a530b245a service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:31.895698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c414f4-3ca0-4b1d-8746-2e2a530b245a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:31.904819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c414f4-3ca0-4b1d-8746-2e2a530b245a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:31.906399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c414f4-3ca0-4b1d-8746-2e2a530b245a service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:31.915984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 705/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:32.811056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de42eb-5cf6-4051-a527-51c69bdc701b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:32.812003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de42eb-5cf6-4051-a527-51c69bdc701b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:32.812296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de42eb-5cf6-4051-a527-51c69bdc701b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:32.813708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:39:32.818674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a77c60-d232-4764-8375-3a7e32a61aa9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:32.819093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a77c60-d232-4764-8375-3a7e32a61aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:32.819256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a77c60-d232-4764-8375-3a7e32a61aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:32.837921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-41a77c60-d232-4764-8375-3a7e32a61aa9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:32.839135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-41a77c60-d232-4764-8375-3a7e32a61aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:32.847171 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:33.003113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de42eb-5cf6-4051-a527-51c69bdc701b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:33.017962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de42eb-5cf6-4051-a527-51c69bdc701b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:33.023355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251d0c1-a40d-46f3-a47d-14f5de509eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:33.023979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251d0c1-a40d-46f3-a47d-14f5de509eef service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:33.024265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251d0c1-a40d-46f3-a47d-14f5de509eef service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:33.024546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251d0c1-a40d-46f3-a47d-14f5de509eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:33.032920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251d0c1-a40d-46f3-a47d-14f5de509eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:33.034498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251d0c1-a40d-46f3-a47d-14f5de509eef service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:33.043968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 722/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:33.930202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877092-665c-4a97-893b-d1fae3ed77b3 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:33.930732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877092-665c-4a97-893b-d1fae3ed77b3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:33.930732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1877092-665c-4a97-893b-d1fae3ed77b3 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:33.932864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:33.938180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a680a-488d-47ad-ac02-a9b563f4e11e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:33.938572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a680a-488d-47ad-ac02-a9b563f4e11e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:33.938753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a680a-488d-47ad-ac02-a9b563f4e11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:33.957434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-de0a680a-488d-47ad-ac02-a9b563f4e11e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:33.958631 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-de0a680a-488d-47ad-ac02-a9b563f4e11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:33.966530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:34.115391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877092-665c-4a97-893b-d1fae3ed77b3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:34.130448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1877092-665c-4a97-893b-d1fae3ed77b3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:34.136002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a4837-5b76-416e-b05f-7ce2f67889a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:34.136640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a4837-5b76-416e-b05f-7ce2f67889a7 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:34.136924 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a4837-5b76-416e-b05f-7ce2f67889a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:34.137201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a4837-5b76-416e-b05f-7ce2f67889a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:34.145677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a4837-5b76-416e-b05f-7ce2f67889a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:34.147278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a4837-5b76-416e-b05f-7ce2f67889a7 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:34.156503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 708/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:35.033879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059c060-6add-4188-9462-b3ef7bef9c45 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:35.034407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059c060-6add-4188-9462-b3ef7bef9c45 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:35.034526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059c060-6add-4188-9462-b3ef7bef9c45 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:35.035928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:35.041071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bed14-8473-40f1-8689-c0dd2ae807db None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:35.041511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bed14-8473-40f1-8689-c0dd2ae807db None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:35.041617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bed14-8473-40f1-8689-c0dd2ae807db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:35.059916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-cb0bed14-8473-40f1-8689-c0dd2ae807db None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:35.061106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cb0bed14-8473-40f1-8689-c0dd2ae807db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:35.068746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:35.222767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059c060-6add-4188-9462-b3ef7bef9c45 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:35.237440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059c060-6add-4188-9462-b3ef7bef9c45 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:35.242704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d1181-603a-41bb-afa4-2b63f3427234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:35.244042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1181-603a-41bb-afa4-2b63f3427234 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:35.244366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1181-603a-41bb-afa4-2b63f3427234 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:35.244649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d1181-603a-41bb-afa4-2b63f3427234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:35.253471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d1181-603a-41bb-afa4-2b63f3427234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:35.255114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d1181-603a-41bb-afa4-2b63f3427234 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:35.264925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 725/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:36.133764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067f1a-880a-4a8f-a6ea-e2e537f91dab None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:36.135304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067f1a-880a-4a8f-a6ea-e2e537f91dab None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:36.135304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067f1a-880a-4a8f-a6ea-e2e537f91dab None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:36.135765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:36.140622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb38e-ce45-4210-8a2f-3c6b4e3e312b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:36.141053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb38e-ce45-4210-8a2f-3c6b4e3e312b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:36.141187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb38e-ce45-4210-8a2f-3c6b4e3e312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:36.159484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-27feb38e-ce45-4210-8a2f-3c6b4e3e312b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:36.160664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-27feb38e-ce45-4210-8a2f-3c6b4e3e312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:36.169066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:36.322351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067f1a-880a-4a8f-a6ea-e2e537f91dab None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:36.336418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067f1a-880a-4a8f-a6ea-e2e537f91dab None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:36.342483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f71261-9912-49dc-8870-6d2c8320538f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:36.343136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f71261-9912-49dc-8870-6d2c8320538f service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:36.343423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f71261-9912-49dc-8870-6d2c8320538f service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:36.343703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f71261-9912-49dc-8870-6d2c8320538f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:36.351745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f71261-9912-49dc-8870-6d2c8320538f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:36.357166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f71261-9912-49dc-8870-6d2c8320538f service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:36.362967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 711/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:37.218963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8a48-9aab-4b5b-b7da-206849bde58d None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:37.219498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8a48-9aab-4b5b-b7da-206849bde58d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:37.219498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea8a48-9aab-4b5b-b7da-206849bde58d None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:37.220891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:37.225962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd50503-fa82-449a-9720-2de016b5f533 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:37.226372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd50503-fa82-449a-9720-2de016b5f533 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:37.226517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd50503-fa82-449a-9720-2de016b5f533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:37.246450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5cd50503-fa82-449a-9720-2de016b5f533 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:37.247942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5cd50503-fa82-449a-9720-2de016b5f533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:37.256190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:39:37.405149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8a48-9aab-4b5b-b7da-206849bde58d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:37.419675 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea8a48-9aab-4b5b-b7da-206849bde58d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:37.424916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefce017-bc0a-49d6-8410-6070e6b66727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:37.425540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefce017-bc0a-49d6-8410-6070e6b66727 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:37.425822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefce017-bc0a-49d6-8410-6070e6b66727 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:37.426096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefce017-bc0a-49d6-8410-6070e6b66727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:37.434142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefce017-bc0a-49d6-8410-6070e6b66727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:37.435735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefce017-bc0a-49d6-8410-6070e6b66727 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:37.444859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 728/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:39.368913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346866b0-08e3-4e0a-8aa9-5486f868f1ef None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:39.369468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346866b0-08e3-4e0a-8aa9-5486f868f1ef None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:39.369468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346866b0-08e3-4e0a-8aa9-5486f868f1ef None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:39.370826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:39.376235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b11c4-4ed7-4756-9133-9d0f95af6fe4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:39.376679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b11c4-4ed7-4756-9133-9d0f95af6fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:39.376775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b11c4-4ed7-4756-9133-9d0f95af6fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:39.394539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4b5b11c4-4ed7-4756-9133-9d0f95af6fe4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:39.395776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4b5b11c4-4ed7-4756-9133-9d0f95af6fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:39.404060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:39.441932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346866b0-08e3-4e0a-8aa9-5486f868f1ef None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:39.453043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346866b0-08e3-4e0a-8aa9-5486f868f1ef None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:39.456526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcebf46-ca6d-441d-bef1-5a1fb49348a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:39.457155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcebf46-ca6d-441d-bef1-5a1fb49348a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:39.457440 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcebf46-ca6d-441d-bef1-5a1fb49348a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:39.457717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcebf46-ca6d-441d-bef1-5a1fb49348a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:39.467184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcebf46-ca6d-441d-bef1-5a1fb49348a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:39.468626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcebf46-ca6d-441d-bef1-5a1fb49348a0 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:39.477942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 714/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:41.686092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8e162-10e2-4175-a902-23727628a36c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:41.686610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8e162-10e2-4175-a902-23727628a36c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:41.686721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8e162-10e2-4175-a902-23727628a36c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:41.688112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:41.693454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df7c9-ba51-4184-a93e-88c72a98be05 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:41.693868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df7c9-ba51-4184-a93e-88c72a98be05 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:41.694019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df7c9-ba51-4184-a93e-88c72a98be05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:41.711626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e46df7c9-ba51-4184-a93e-88c72a98be05 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:41.712921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e46df7c9-ba51-4184-a93e-88c72a98be05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:41.720693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:41.759636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8e162-10e2-4175-a902-23727628a36c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:41.770082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8e162-10e2-4175-a902-23727628a36c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:41.773615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4fcbe-92f9-44bf-98d6-259570311031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:41.774245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4fcbe-92f9-44bf-98d6-259570311031 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:41.774559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4fcbe-92f9-44bf-98d6-259570311031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:41.774991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4fcbe-92f9-44bf-98d6-259570311031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:41.783756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4fcbe-92f9-44bf-98d6-259570311031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:41.785188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4fcbe-92f9-44bf-98d6-259570311031 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:41.794978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 731/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:44.239661 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2beab-a3a3-410b-8084-c41ed26642c4 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:44.240198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2beab-a3a3-410b-8084-c41ed26642c4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:44.240198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2beab-a3a3-410b-8084-c41ed26642c4 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:44.241579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:44.246836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afb241-1226-4a01-9800-b22681bbd24e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:44.247279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afb241-1226-4a01-9800-b22681bbd24e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:44.247426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afb241-1226-4a01-9800-b22681bbd24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:44.267085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-85afb241-1226-4a01-9800-b22681bbd24e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:44.268273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-85afb241-1226-4a01-9800-b22681bbd24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:44.277191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:44.316051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2beab-a3a3-410b-8084-c41ed26642c4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:44.326627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2beab-a3a3-410b-8084-c41ed26642c4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:44.330112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd62f-b4e9-432c-82ca-1492c2a4c5d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:44.330743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd62f-b4e9-432c-82ca-1492c2a4c5d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:44.331057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd62f-b4e9-432c-82ca-1492c2a4c5d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:44.331337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd62f-b4e9-432c-82ca-1492c2a4c5d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:44.340631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fd62f-b4e9-432c-82ca-1492c2a4c5d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:44.342049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fd62f-b4e9-432c-82ca-1492c2a4c5d8 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:44.351353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 717/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:46.513725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dca82e-fe08-454e-b3aa-fbaf1328a2a6 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:46.514313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dca82e-fe08-454e-b3aa-fbaf1328a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:46.514313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dca82e-fe08-454e-b3aa-fbaf1328a2a6 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:46.515693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:46.520945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3eb92-6b70-4168-bd1d-ba3bc3610510 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:46.521418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3eb92-6b70-4168-bd1d-ba3bc3610510 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:46.521525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3eb92-6b70-4168-bd1d-ba3bc3610510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:46.539073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-13d3eb92-6b70-4168-bd1d-ba3bc3610510 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:46.540353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-13d3eb92-6b70-4168-bd1d-ba3bc3610510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:46.548391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:46.587441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dca82e-fe08-454e-b3aa-fbaf1328a2a6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:46.604906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dca82e-fe08-454e-b3aa-fbaf1328a2a6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:46.608534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497d23-712c-4d6a-aa77-44f6074b1036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:46.609179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497d23-712c-4d6a-aa77-44f6074b1036 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:46.609462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497d23-712c-4d6a-aa77-44f6074b1036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:46.609738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497d23-712c-4d6a-aa77-44f6074b1036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:46.619629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8497d23-712c-4d6a-aa77-44f6074b1036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:46.621084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8497d23-712c-4d6a-aa77-44f6074b1036 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:46.630633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 734/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:48.739369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322b9b-ebf6-4040-b526-608c74dcae44 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:48.739917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322b9b-ebf6-4040-b526-608c74dcae44 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:48.739917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7322b9b-ebf6-4040-b526-608c74dcae44 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:48.741309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:48.746743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cf159-ba51-4076-b72f-1911d93e488e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:48.747174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cf159-ba51-4076-b72f-1911d93e488e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:48.747337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cf159-ba51-4076-b72f-1911d93e488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:48.765060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d33cf159-ba51-4076-b72f-1911d93e488e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:48.766244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d33cf159-ba51-4076-b72f-1911d93e488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:48.773963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:48.813270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322b9b-ebf6-4040-b526-608c74dcae44 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:48.824262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7322b9b-ebf6-4040-b526-608c74dcae44 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:48.827767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ddede-6ea4-42a9-88e4-f0bcc5be8f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:48.828387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ddede-6ea4-42a9-88e4-f0bcc5be8f42 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:48.828673 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ddede-6ea4-42a9-88e4-f0bcc5be8f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:48.828954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ddede-6ea4-42a9-88e4-f0bcc5be8f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:48.838334 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ddede-6ea4-42a9-88e4-f0bcc5be8f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:48.839810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ddede-6ea4-42a9-88e4-f0bcc5be8f42 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:48.849251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 720/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:50.949301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e1201-3fab-4166-8480-ae95844b8e76 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:50.949814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e1201-3fab-4166-8480-ae95844b8e76 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:50.949814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e1201-3fab-4166-8480-ae95844b8e76 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:50.951222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:39:50.956358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234be82-37c2-47cd-97d5-8311ee513155 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:50.956764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234be82-37c2-47cd-97d5-8311ee513155 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:50.956927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234be82-37c2-47cd-97d5-8311ee513155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:50.975347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a234be82-37c2-47cd-97d5-8311ee513155 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:50.976557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a234be82-37c2-47cd-97d5-8311ee513155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:50.985133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:51.022895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e1201-3fab-4166-8480-ae95844b8e76 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:51.033951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e1201-3fab-4166-8480-ae95844b8e76 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:51.037416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319ff93-d618-47ce-a86c-a97a41059049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:51.038043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319ff93-d618-47ce-a86c-a97a41059049 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:51.038326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319ff93-d618-47ce-a86c-a97a41059049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:51.038602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319ff93-d618-47ce-a86c-a97a41059049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:51.047975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319ff93-d618-47ce-a86c-a97a41059049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:51.049383 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319ff93-d618-47ce-a86c-a97a41059049 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:51.058663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 737/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:53.141179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109ced-63b6-4a71-b9b4-23a4eab0e322 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:53.141759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109ced-63b6-4a71-b9b4-23a4eab0e322 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:53.141759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0109ced-63b6-4a71-b9b4-23a4eab0e322 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:53.143172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:53.148251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860f3ca-04f2-4198-9abf-ddda4a54535c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:53.148670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860f3ca-04f2-4198-9abf-ddda4a54535c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:53.148812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860f3ca-04f2-4198-9abf-ddda4a54535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:53.155531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=70 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:53.168153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0860f3ca-04f2-4198-9abf-ddda4a54535c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:53.171019 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0860f3ca-04f2-4198-9abf-ddda4a54535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:53.177080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:53.215418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109ced-63b6-4a71-b9b4-23a4eab0e322 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:53.220744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=73 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:39:53.226453 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0109ced-63b6-4a71-b9b4-23a4eab0e322 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:53.230673 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1071af9-f5e6-4559-9562-7496cfe3cc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:53.231371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1071af9-f5e6-4559-9562-7496cfe3cc49 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:53.231658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1071af9-f5e6-4559-9562-7496cfe3cc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:53.231939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1071af9-f5e6-4559-9562-7496cfe3cc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:53.240997 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1071af9-f5e6-4559-9562-7496cfe3cc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:53.242436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1071af9-f5e6-4559-9562-7496cfe3cc49 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:53.253430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 723/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:55.340869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7f9d-fbb4-49ba-941e-e6171f1a1172 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:55.341420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7f9d-fbb4-49ba-941e-e6171f1a1172 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:55.341420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af7f9d-fbb4-49ba-941e-e6171f1a1172 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:55.342792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:55.347927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4b00b-e275-4e67-96ac-251dcf69fb31 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:55.348353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4b00b-e275-4e67-96ac-251dcf69fb31 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:55.348488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4b00b-e275-4e67-96ac-251dcf69fb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:55.367412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-26d4b00b-e275-4e67-96ac-251dcf69fb31 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:55.369229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-26d4b00b-e275-4e67-96ac-251dcf69fb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:55.377329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:55.414690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7f9d-fbb4-49ba-941e-e6171f1a1172 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:55.426501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af7f9d-fbb4-49ba-941e-e6171f1a1172 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:55.430040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b053eea-c3cc-4f70-93cb-10d7d962d029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:55.430675 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b053eea-c3cc-4f70-93cb-10d7d962d029 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:55.431023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b053eea-c3cc-4f70-93cb-10d7d962d029 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:55.431303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b053eea-c3cc-4f70-93cb-10d7d962d029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:55.440112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b053eea-c3cc-4f70-93cb-10d7d962d029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:55.441534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b053eea-c3cc-4f70-93cb-10d7d962d029 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:55.451195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 740/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:57.520852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17989a48-e9e4-4bda-85a2-f43e4edf3778 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:57.521419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17989a48-e9e4-4bda-85a2-f43e4edf3778 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:57.521419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17989a48-e9e4-4bda-85a2-f43e4edf3778 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:57.522767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:57.528622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29891474-e068-4a47-ab3d-04dca33db137 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:57.529024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29891474-e068-4a47-ab3d-04dca33db137 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:57.529175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29891474-e068-4a47-ab3d-04dca33db137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:57.546452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-29891474-e068-4a47-ab3d-04dca33db137 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:57.547674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-29891474-e068-4a47-ab3d-04dca33db137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:57.555268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:57.592399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17989a48-e9e4-4bda-85a2-f43e4edf3778 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:57.603222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17989a48-e9e4-4bda-85a2-f43e4edf3778 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:57.606922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901a3ea-0c08-4180-a10d-2a6a492fc307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:57.607568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901a3ea-0c08-4180-a10d-2a6a492fc307 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:57.607855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901a3ea-0c08-4180-a10d-2a6a492fc307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:57.608135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901a3ea-0c08-4180-a10d-2a6a492fc307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:57.629719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901a3ea-0c08-4180-a10d-2a6a492fc307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:57.629719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901a3ea-0c08-4180-a10d-2a6a492fc307 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:57.629719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 726/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:39:59.704468 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934f16-cb71-4191-bb2d-c9d473775715 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:59.705025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934f16-cb71-4191-bb2d-c9d473775715 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:59.705025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb934f16-cb71-4191-bb2d-c9d473775715 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:59.706393 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:39:59.711529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bd82d-d67f-4349-9e70-cbc8d06092e3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:59.711923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bd82d-d67f-4349-9e70-cbc8d06092e3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:59.712118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bd82d-d67f-4349-9e70-cbc8d06092e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:59.730763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-140bd82d-d67f-4349-9e70-cbc8d06092e3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:39:59.731961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-140bd82d-d67f-4349-9e70-cbc8d06092e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:39:59.739636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:39:59.776368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934f16-cb71-4191-bb2d-c9d473775715 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:39:59.787450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb934f16-cb71-4191-bb2d-c9d473775715 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:39:59.792073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477ace8-e5b7-43d9-b95d-8aec6786eb43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:39:59.792775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477ace8-e5b7-43d9-b95d-8aec6786eb43 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:39:59.793184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477ace8-e5b7-43d9-b95d-8aec6786eb43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:39:59.793596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477ace8-e5b7-43d9-b95d-8aec6786eb43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:39:59.804587 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477ace8-e5b7-43d9-b95d-8aec6786eb43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:39:59.807061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477ace8-e5b7-43d9-b95d-8aec6786eb43 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:39:59.816241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 743/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:40:09.724805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=17 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:40:09.812093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=17 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:40:19.793707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166a7b5-5c6d-4ec9-8a77-399d0f881007 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:19.794268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166a7b5-5c6d-4ec9-8a77-399d0f881007 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:19.794268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166a7b5-5c6d-4ec9-8a77-399d0f881007 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:19.795635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 728/1471] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:40:19.801007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122828-aa72-4df4-a485-cca0e99cc4fa None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:19.801420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122828-aa72-4df4-a485-cca0e99cc4fa None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:19.801572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122828-aa72-4df4-a485-cca0e99cc4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:19.819647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-72122828-aa72-4df4-a485-cca0e99cc4fa None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:40:19.820847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-72122828-aa72-4df4-a485-cca0e99cc4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:40:19.828914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 744/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:40:19.876940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d0196-09bb-4ff4-b6e1-225acc9ad450 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:19.877226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d0196-09bb-4ff4-b6e1-225acc9ad450 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:19.877501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d0196-09bb-4ff4-b6e1-225acc9ad450 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:19.878837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 729/1473] 10.222.0.42 () {54 vars in 962 bytes} [Fri Jun 24 09:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:40:19.883596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f5c84-6f82-4d62-926b-257ec08a499b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:19.883973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f5c84-6f82-4d62-926b-257ec08a499b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:19.884305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f5c84-6f82-4d62-926b-257ec08a499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:19.901823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f29f5c84-6f82-4d62-926b-257ec08a499b None None] MFA Rules not processed for user `d0a8a5a1bc174acd9b13477c7d4b4a07`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:40:19.903062 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f29f5c84-6f82-4d62-926b-257ec08a499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:40:19.909409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 745/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Jun 24 09:40:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:40:19.917293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d0196-09bb-4ff4-b6e1-225acc9ad450 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:40:19.927813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d0196-09bb-4ff4-b6e1-225acc9ad450 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:40:19.931896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ab6c8-5850-4319-8058-33600e6412c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0a8a5a1bc174acd9b13477c7d4b4a07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:40:19.932517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab6c8-5850-4319-8058-33600e6412c1 service glance] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:19.932795 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab6c8-5850-4319-8058-33600e6412c1 service glance] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:19.933063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ab6c8-5850-4319-8058-33600e6412c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:19.941797 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab6c8-5850-4319-8058-33600e6412c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:40:19.943270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ab6c8-5850-4319-8058-33600e6412c1 service glance] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:40:19.952600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 730/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:40:22.054253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4324e-27d7-4550-8bc9-6af34cb5a2a5 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:22.054805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4324e-27d7-4550-8bc9-6af34cb5a2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:22.054805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4324e-27d7-4550-8bc9-6af34cb5a2a5 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:22.056713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 746/1476] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:40:22.061844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dac38-f3d4-493c-9ff7-db0507e39f7f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:22.062265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dac38-f3d4-493c-9ff7-db0507e39f7f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:22.062401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dac38-f3d4-493c-9ff7-db0507e39f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:22.081549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ce1dac38-f3d4-493c-9ff7-db0507e39f7f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:40:22.082748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ce1dac38-f3d4-493c-9ff7-db0507e39f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:40:22.091474 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 731/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:40:22.115743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4324e-27d7-4550-8bc9-6af34cb5a2a5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:40:22.130568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4324e-27d7-4550-8bc9-6af34cb5a2a5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:40:22.133199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911e619-6ea4-4fd1-af37-3a70689d9df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:40:22.134346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911e619-6ea4-4fd1-af37-3a70689d9df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:22.135208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911e619-6ea4-4fd1-af37-3a70689d9df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:22.135491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911e619-6ea4-4fd1-af37-3a70689d9df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:22.136218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911e619-6ea4-4fd1-af37-3a70689d9df5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:40:22.137994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-9911e619-6ea4-4fd1-af37-3a70689d9df5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:40:22.137994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 09:40:22.137994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: Jun 24 09:40:22.139155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911e619-6ea4-4fd1-af37-3a70689d9df5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:40:22.158865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 747/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 09:40:22 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:40:24.229719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca93f4-25fe-4337-8261-8a69f5712f00 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:24.230262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca93f4-25fe-4337-8261-8a69f5712f00 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:24.230262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca93f4-25fe-4337-8261-8a69f5712f00 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:24.231703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 732/1479] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:40:24.236980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7829c33-d86d-426f-86d2-fc3b07c6ff7e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:24.237410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7829c33-d86d-426f-86d2-fc3b07c6ff7e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:24.237543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7829c33-d86d-426f-86d2-fc3b07c6ff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:24.255329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a7829c33-d86d-426f-86d2-fc3b07c6ff7e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:40:24.256521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a7829c33-d86d-426f-86d2-fc3b07c6ff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:40:24.264831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 748/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:40:24.307998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca93f4-25fe-4337-8261-8a69f5712f00 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:40:24.322877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca93f4-25fe-4337-8261-8a69f5712f00 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:40:24.328251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef8ad7-54b2-4617-80a9-1297ed66ceef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:40:24.328881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef8ad7-54b2-4617-80a9-1297ed66ceef service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:24.329159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef8ad7-54b2-4617-80a9-1297ed66ceef service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:24.329432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef8ad7-54b2-4617-80a9-1297ed66ceef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:24.338439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef8ad7-54b2-4617-80a9-1297ed66ceef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:40:24.340060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef8ad7-54b2-4617-80a9-1297ed66ceef service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:40:24.349319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 733/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:40:26.569284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8984b2-9310-4195-b38a-6f18e470a745 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:26.569817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8984b2-9310-4195-b38a-6f18e470a745 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:26.569817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8984b2-9310-4195-b38a-6f18e470a745 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:26.571297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 749/1482] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:40:26.576624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02810d7-bc54-4c2c-b539-6b318fe2bc58 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:26.577041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02810d7-bc54-4c2c-b539-6b318fe2bc58 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:26.577148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02810d7-bc54-4c2c-b539-6b318fe2bc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:26.595074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b02810d7-bc54-4c2c-b539-6b318fe2bc58 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:40:26.596276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b02810d7-bc54-4c2c-b539-6b318fe2bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:40:26.604558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 734/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:40:26.641040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8984b2-9310-4195-b38a-6f18e470a745 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:40:26.651799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8984b2-9310-4195-b38a-6f18e470a745 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:40:26.655341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed74077-96c7-451a-a7b9-8bf7dbb130ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:40:26.659030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed74077-96c7-451a-a7b9-8bf7dbb130ff service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:26.659030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed74077-96c7-451a-a7b9-8bf7dbb130ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:26.659030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed74077-96c7-451a-a7b9-8bf7dbb130ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:26.666394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed74077-96c7-451a-a7b9-8bf7dbb130ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:40:26.667858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed74077-96c7-451a-a7b9-8bf7dbb130ff service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:40:26.677396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 750/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:40:28.771816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409877f-db12-4f8c-b7d9-0d89b6b625c0 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:28.772377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409877f-db12-4f8c-b7d9-0d89b6b625c0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:28.772377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409877f-db12-4f8c-b7d9-0d89b6b625c0 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:28.773796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 735/1485] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:40:28.779391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b63572-f97a-4bc2-8248-d33d093d98ee None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:28.779827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b63572-f97a-4bc2-8248-d33d093d98ee None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:28.779975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b63572-f97a-4bc2-8248-d33d093d98ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:28.797616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-55b63572-f97a-4bc2-8248-d33d093d98ee None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:40:28.798790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-55b63572-f97a-4bc2-8248-d33d093d98ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:40:28.807360 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 751/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:40:28.845739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409877f-db12-4f8c-b7d9-0d89b6b625c0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:40:28.856768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409877f-db12-4f8c-b7d9-0d89b6b625c0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:40:28.860225 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f425f-2fd1-4151-9874-39fdc1efc143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:40:28.860856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f425f-2fd1-4151-9874-39fdc1efc143 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:28.861137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f425f-2fd1-4151-9874-39fdc1efc143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:28.861413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f425f-2fd1-4151-9874-39fdc1efc143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:28.870744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f425f-2fd1-4151-9874-39fdc1efc143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:40:28.872203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f425f-2fd1-4151-9874-39fdc1efc143 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:40:28.881671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 736/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:40:31.114736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581d645-07df-4960-a7c1-7468280fdda8 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:31.115366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581d645-07df-4960-a7c1-7468280fdda8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:31.115366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581d645-07df-4960-a7c1-7468280fdda8 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:31.116766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 752/1488] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:40:31.122979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb23aac-2094-45d9-9b70-248a6b147e24 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:31.123405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb23aac-2094-45d9-9b70-248a6b147e24 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:31.123536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb23aac-2094-45d9-9b70-248a6b147e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:31.141497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-dcb23aac-2094-45d9-9b70-248a6b147e24 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:40:31.142678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-dcb23aac-2094-45d9-9b70-248a6b147e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:40:31.150666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 737/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:40:31.192496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581d645-07df-4960-a7c1-7468280fdda8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:40:31.203064 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581d645-07df-4960-a7c1-7468280fdda8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:40:31.206656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19944ac0-b1dd-4a47-86cd-3d78128ffd9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:40:31.207322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19944ac0-b1dd-4a47-86cd-3d78128ffd9d service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:31.207611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19944ac0-b1dd-4a47-86cd-3d78128ffd9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:31.207890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19944ac0-b1dd-4a47-86cd-3d78128ffd9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:31.217198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19944ac0-b1dd-4a47-86cd-3d78128ffd9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:40:31.218617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19944ac0-b1dd-4a47-86cd-3d78128ffd9d service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:40:31.228783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 753/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:40:33.615198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bddacb-7ad9-4fe2-919b-7084f14afe03 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:33.615687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bddacb-7ad9-4fe2-919b-7084f14afe03 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:33.615796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bddacb-7ad9-4fe2-919b-7084f14afe03 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:33.617116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 738/1491] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 09:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:40:33.622269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b54f36-c134-4baf-a4db-f2c3ca8e95a3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:33.622750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b54f36-c134-4baf-a4db-f2c3ca8e95a3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:33.622897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b54f36-c134-4baf-a4db-f2c3ca8e95a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:33.640970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c9b54f36-c134-4baf-a4db-f2c3ca8e95a3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:40:33.642164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c9b54f36-c134-4baf-a4db-f2c3ca8e95a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:40:33.650554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 754/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 09:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:40:33.689390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bddacb-7ad9-4fe2-919b-7084f14afe03 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:40:33.700237 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bddacb-7ad9-4fe2-919b-7084f14afe03 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:40:33.703818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774425be-69be-4e3f-b1cc-f350d16de60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:40:33.704452 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774425be-69be-4e3f-b1cc-f350d16de60d service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:40:33.704737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774425be-69be-4e3f-b1cc-f350d16de60d service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:40:33.705015 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774425be-69be-4e3f-b1cc-f350d16de60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:40:33.714424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774425be-69be-4e3f-b1cc-f350d16de60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:40:33.715901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774425be-69be-4e3f-b1cc-f350d16de60d service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:40:33.725305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 739/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:40:43.635627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=33 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:40:43.721174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=33 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:06.550459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0da2-3c2a-4195-a0a6-fff3b5a9489b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:06.551083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0da2-3c2a-4195-a0a6-fff3b5a9489b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:06.551083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d0da2-3c2a-4195-a0a6-fff3b5a9489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:06.569324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1a4d0da2-3c2a-4195-a0a6-fff3b5a9489b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:42:06.570536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1a4d0da2-3c2a-4195-a0a6-fff3b5a9489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:42:06.578653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 755/1494] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:42:06.588476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc5c3-df97-4529-92ca-6db0f931dfcd None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:06.589071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc5c3-df97-4529-92ca-6db0f931dfcd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:06.589071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbc5c3-df97-4529-92ca-6db0f931dfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:06.608872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-17cbc5c3-df97-4529-92ca-6db0f931dfcd None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:42:06.610021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-17cbc5c3-df97-4529-92ca-6db0f931dfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:42:06.618010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 740/1495] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:42:06.622692 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0da2-3c2a-4195-a0a6-fff3b5a9489b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:06.632475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d0da2-3c2a-4195-a0a6-fff3b5a9489b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:06.637162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:06.637814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:06.638101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:06.638382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:06.639141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:42:06.639452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:06.640471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:42:06.640471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 09:42:06.640471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: Jun 24 09:42:06.641348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:06.653510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 756/1496] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:42:06.661429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbc5c3-df97-4529-92ca-6db0f931dfcd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:06.671543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbc5c3-df97-4529-92ca-6db0f931dfcd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:06.676200 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfda02-677e-4c57-b851-f26346b58a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:06.676846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfda02-677e-4c57-b851-f26346b58a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:06.677132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfda02-677e-4c57-b851-f26346b58a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:06.677410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfda02-677e-4c57-b851-f26346b58a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:06.678112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfda02-677e-4c57-b851-f26346b58a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:06.679876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-efcfda02-677e-4c57-b851-f26346b58a88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:42:06.679876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 09:42:06.679876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: Jun 24 09:42:06.681394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfda02-677e-4c57-b851-f26346b58a88 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:06.785924 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 741/1497] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:42:06 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:42:06.790239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:06.800950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5110ca-5a6b-40ec-a1e5-9b542cd86a1c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:06.856021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e3fc6-00c5-46b3-910b-f90781973def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:06.856687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e3fc6-00c5-46b3-910b-f90781973def admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:06.856980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e3fc6-00c5-46b3-910b-f90781973def admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:06.857261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e3fc6-00c5-46b3-910b-f90781973def admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:06.857953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e3fc6-00c5-46b3-910b-f90781973def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:06.859052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-740e3fc6-00c5-46b3-910b-f90781973def admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:42:06.859052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 09:42:06.859052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: Jun 24 09:42:06.860196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e3fc6-00c5-46b3-910b-f90781973def admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:06.923042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 757/1498] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:42:06 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:42:06.927209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfda02-677e-4c57-b851-f26346b58a88 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:06.937913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfda02-677e-4c57-b851-f26346b58a88 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:06.942473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e4da-4afb-4906-8f89-5bc2dccf17c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:06.943174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e4da-4afb-4906-8f89-5bc2dccf17c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:06.943459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e4da-4afb-4906-8f89-5bc2dccf17c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:06.943732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e4da-4afb-4906-8f89-5bc2dccf17c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:06.944463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719e4da-4afb-4906-8f89-5bc2dccf17c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:06.945508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-4719e4da-4afb-4906-8f89-5bc2dccf17c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:42:06.945508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 09:42:06.945508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: Jun 24 09:42:06.946387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719e4da-4afb-4906-8f89-5bc2dccf17c1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:06.959403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 742/1499] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:42:06.964306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e3fc6-00c5-46b3-910b-f90781973def admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:06.974166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e3fc6-00c5-46b3-910b-f90781973def admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:06.979995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133382cd-a3a4-4e82-afeb-e7eccea6e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:06.980678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133382cd-a3a4-4e82-afeb-e7eccea6e179 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:06.980964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133382cd-a3a4-4e82-afeb-e7eccea6e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:06.981238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133382cd-a3a4-4e82-afeb-e7eccea6e179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:06.981962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133382cd-a3a4-4e82-afeb-e7eccea6e179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:06.983093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-133382cd-a3a4-4e82-afeb-e7eccea6e179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:42:06.983093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 09:42:06.983093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: Jun 24 09:42:06.983971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133382cd-a3a4-4e82-afeb-e7eccea6e179 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:06.997651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 758/1500] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:42:07.001887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e4da-4afb-4906-8f89-5bc2dccf17c1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:07.012929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e4da-4afb-4906-8f89-5bc2dccf17c1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:07.017501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f948e83-5d92-49a9-8204-3e87d650f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:07.018378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948e83-5d92-49a9-8204-3e87d650f746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:07.018664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948e83-5d92-49a9-8204-3e87d650f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:07.018996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f948e83-5d92-49a9-8204-3e87d650f746 admin admin] PATH_INFO: `/v3/projects/c9ef7188ad6b445f9bc746900c7e1925/users/7fb79f4e28504b4f82a8bbb9f5c61299/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:07.034105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f948e83-5d92-49a9-8204-3e87d650f746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ef7188ad6b445f9bc746900c7e1925, user_id=7fb79f4e28504b4f82a8bbb9f5c61299, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:07.035180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-3f948e83-5d92-49a9-8204-3e87d650f746 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:42:07.035180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 09:42:07.035180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: Jun 24 09:42:07.037109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f948e83-5d92-49a9-8204-3e87d650f746 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:07.105554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 743/1501] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:42:07 2022] PUT /identity/v3/projects/c9ef7188ad6b445f9bc746900c7e1925/users/7fb79f4e28504b4f82a8bbb9f5c61299/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:42:07.117164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e3ba-b769-460d-b2d6-c3a458a668a5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:07.117428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e3ba-b769-460d-b2d6-c3a458a668a5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:07.117742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50e3ba-b769-460d-b2d6-c3a458a668a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:07.143882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2a50e3ba-b769-460d-b2d6-c3a458a668a5 None None] MFA Rules not processed for user `7fb79f4e28504b4f82a8bbb9f5c61299`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:42:07.145111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2a50e3ba-b769-460d-b2d6-c3a458a668a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:42:07.208439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 759/1502] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:42:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:42:07.222196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46515f-5852-4e2a-869d-b7859c8c633f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:07.222511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46515f-5852-4e2a-869d-b7859c8c633f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:07.222809 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46515f-5852-4e2a-869d-b7859c8c633f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:07.224198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 744/1503] 10.222.0.42 () {54 vars in 963 bytes} [Fri Jun 24 09:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:42:07.229000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8752-36a4-4227-88ca-8ff236ef7979 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:07.229293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8752-36a4-4227-88ca-8ff236ef7979 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:07.229582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee8752-36a4-4227-88ca-8ff236ef7979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:07.246986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b4ee8752-36a4-4227-88ca-8ff236ef7979 None None] MFA Rules not processed for user `ee91a24eb66d4753bc6a81d278b1088f`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:42:07.248196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b4ee8752-36a4-4227-88ca-8ff236ef7979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:42:07.291755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:07.299097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 760/1504] 10.222.0.42 () {58 vars in 1060 bytes} [Fri Jun 24 09:42:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:42:07.315223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46515f-5852-4e2a-869d-b7859c8c633f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:07.317553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc46515f-5852-4e2a-869d-b7859c8c633f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:07.321228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d82d-945b-4459-86a2-3bcc45353f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:07.322333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d82d-945b-4459-86a2-3bcc45353f14 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:07.322610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d82d-945b-4459-86a2-3bcc45353f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:07.322917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d82d-945b-4459-86a2-3bcc45353f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:07.331072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987d82d-945b-4459-86a2-3bcc45353f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:07.332494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987d82d-945b-4459-86a2-3bcc45353f14 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:07.342112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 745/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:42:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:42:07.384129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7f012-bc0b-4682-ad4e-7f21889583a1 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:07.385049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7f012-bc0b-4682-ad4e-7f21889583a1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:07.385338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7f012-bc0b-4682-ad4e-7f21889583a1 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:07.386639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 761/1506] 10.222.0.42 () {52 vars in 829 bytes} [Fri Jun 24 09:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:42:07.390252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d82d-945b-4459-86a2-3bcc45353f14 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:07.450994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d82d-945b-4459-86a2-3bcc45353f14 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:07.455595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:07.456444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:07.456723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:07.456995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] PATH_INFO: `/v3/users/7fb79f4e28504b4f82a8bbb9f5c61299` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:07.458154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb79f4e28504b4f82a8bbb9f5c61299)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:07.459198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:42:07.459198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 09:42:07.459198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: Jun 24 09:42:07.460382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:07.621756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb79f4e28504b4f82a8bbb9f5c61299'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:07.622324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb79f4e28504b4f82a8bbb9f5c61299'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:07.641808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb79f4e28504b4f82a8bbb9f5c61299'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:07.656168 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb79f4e28504b4f82a8bbb9f5c61299'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:07.660115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:07.720831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb79f4e28504b4f82a8bbb9f5c61299'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:07.727235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 746/1507] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:42:07 2022] DELETE /identity/v3/users/7fb79f4e28504b4f82a8bbb9f5c61299 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:42:07.732201 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a63c2-b72b-4f9a-a149-c5e54cdd6c9a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:07.732647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a63c2-b72b-4f9a-a149-c5e54cdd6c9a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:07.732771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a63c2-b72b-4f9a-a149-c5e54cdd6c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:07.750798 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-886a63c2-b72b-4f9a-a149-c5e54cdd6c9a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:42:07.752006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-886a63c2-b72b-4f9a-a149-c5e54cdd6c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:42:07.810927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 762/1508] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:42:07.820503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:07.822045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:42:07.880036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f0e6e-5307-4228-8332-ea43ba4a52ee admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:07.883546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554e294-b359-424f-bff8-99bd4dafc72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:07.884217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554e294-b359-424f-bff8-99bd4dafc72c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:07.884506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554e294-b359-424f-bff8-99bd4dafc72c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:07.884785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554e294-b359-424f-bff8-99bd4dafc72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:07.893614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554e294-b359-424f-bff8-99bd4dafc72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:07.895083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554e294-b359-424f-bff8-99bd4dafc72c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:07.904548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 747/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:42:08.387133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a63c2-b72b-4f9a-a149-c5e54cdd6c9a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:42:08.388655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-886a63c2-b72b-4f9a-a149-c5e54cdd6c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:42:08.401630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a63c2-b72b-4f9a-a149-c5e54cdd6c9a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:42:08.407600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:42:08.408467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:42:08.408754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:42:08.409028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] PATH_INFO: `/v3/projects/c9ef7188ad6b445f9bc746900c7e1925` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:42:08.410219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ef7188ad6b445f9bc746900c7e1925)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:42:08.411271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:42:08.411271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 09:42:08.411271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: Jun 24 09:42:08.413139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:42:08.528705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ef7188ad6b445f9bc746900c7e1925', 'request_id': 'req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:08.590632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ef7188ad6b445f9bc746900c7e1925', 'request_id': 'req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:08.597719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ef7188ad6b445f9bc746900c7e1925', 'request_id': 'req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:08.616409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] The token cache is being invalidate because project c9ef7188ad6b445f9bc746900c7e1925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:42:08.616699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:08.617359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a3fd41f-a3ee-40d0-a563-d61a7eb2e02c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:42:08.619187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 763/1510] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:42:08 2022] DELETE /identity/v3/projects/c9ef7188ad6b445f9bc746900c7e1925 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:42:17.900684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:42:18.613416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:43:53.515595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad75552-f936-46fe-884e-de95a58db7cf None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:43:53.516177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad75552-f936-46fe-884e-de95a58db7cf None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:43:53.516177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad75552-f936-46fe-884e-de95a58db7cf None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:43:53.517557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:43:53.523087 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9199f-6e5f-4a72-a5f8-cf4d870a5ea7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:43:53.523531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9199f-6e5f-4a72-a5f8-cf4d870a5ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:43:53.523629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9199f-6e5f-4a72-a5f8-cf4d870a5ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:43:53.541505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b7b9199f-6e5f-4a72-a5f8-cf4d870a5ea7 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:43:53.542702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b7b9199f-6e5f-4a72-a5f8-cf4d870a5ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:43:53.601900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:43:53.760825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad75552-f936-46fe-884e-de95a58db7cf None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:43:53.771602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9ad75552-f936-46fe-884e-de95a58db7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:43:53.836991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad75552-f936-46fe-884e-de95a58db7cf None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:43:53.842383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640249bc-b427-4456-ac80-ce8e7ce6f710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:43:53.843054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640249bc-b427-4456-ac80-ce8e7ce6f710 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:43:53.843344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640249bc-b427-4456-ac80-ce8e7ce6f710 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:43:53.843626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640249bc-b427-4456-ac80-ce8e7ce6f710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:43:53.852499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640249bc-b427-4456-ac80-ce8e7ce6f710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:43:53.854102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640249bc-b427-4456-ac80-ce8e7ce6f710 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:43:53.863470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 749/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:43:54.696104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69a24a-d46a-4d8a-9744-c8471f3757cf None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:43:54.696662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69a24a-d46a-4d8a-9744-c8471f3757cf None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:43:54.696662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69a24a-d46a-4d8a-9744-c8471f3757cf None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:43:54.698043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:43:54.702878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110803d1-b58c-4ce0-8a37-33e74301881d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:43:54.703269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110803d1-b58c-4ce0-8a37-33e74301881d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:43:54.703456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110803d1-b58c-4ce0-8a37-33e74301881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:43:54.722033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-110803d1-b58c-4ce0-8a37-33e74301881d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:43:54.723963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-110803d1-b58c-4ce0-8a37-33e74301881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:43:54.731783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:43:54.884459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69a24a-d46a-4d8a-9744-c8471f3757cf None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:43:54.898880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69a24a-d46a-4d8a-9744-c8471f3757cf None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:43:54.904342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a31d44c-29dd-458b-bc2e-df60d2979046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:43:54.904980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31d44c-29dd-458b-bc2e-df60d2979046 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:43:54.905263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31d44c-29dd-458b-bc2e-df60d2979046 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:43:54.905539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a31d44c-29dd-458b-bc2e-df60d2979046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:43:54.913571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31d44c-29dd-458b-bc2e-df60d2979046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:43:54.915177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a31d44c-29dd-458b-bc2e-df60d2979046 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:43:54.924237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 766/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:43:55.221859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742ec4-7d3f-4f4e-b0b2-5819134dde32 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:43:55.222093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742ec4-7d3f-4f4e-b0b2-5819134dde32 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:43:55.222375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e742ec4-7d3f-4f4e-b0b2-5819134dde32 None None] PATH_INFO: `/v3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:43:55.224676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 751/1517] 10.222.0.23 () {54 vars in 925 bytes} [Fri Jun 24 09:43:55 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:43:55.230724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a757a3-3b2d-4c82-90a6-d5d34f7a3b57 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:43:55.231039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a757a3-3b2d-4c82-90a6-d5d34f7a3b57 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:43:55.231320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a757a3-3b2d-4c82-90a6-d5d34f7a3b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:43:55.249640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a6a757a3-3b2d-4c82-90a6-d5d34f7a3b57 None None] MFA Rules not processed for user `87fd5580ed264a08a3ad31850e0a53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:43:55.250826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a6a757a3-3b2d-4c82-90a6-d5d34f7a3b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:43:55.313215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 767/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Jun 24 09:43:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:44:04.474669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a66b-084c-446a-ac09-de65f323cbcd None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:04.475253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a66b-084c-446a-ac09-de65f323cbcd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:04.475253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377a66b-084c-446a-ac09-de65f323cbcd None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:04.477127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 752/1519] 10.222.0.42 () {54 vars in 960 bytes} [Fri Jun 24 09:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:44:04.481956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab3064-2ba0-404a-ab96-76a36654c8cd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:04.482370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab3064-2ba0-404a-ab96-76a36654c8cd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:04.482531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab3064-2ba0-404a-ab96-76a36654c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:04.502752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d1ab3064-2ba0-404a-ab96-76a36654c8cd None None] MFA Rules not processed for user `87fd5580ed264a08a3ad31850e0a53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:44:04.503990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d1ab3064-2ba0-404a-ab96-76a36654c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:04.512758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 768/1520] 10.222.0.42 () {58 vars in 1057 bytes} [Fri Jun 24 09:44:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:44:04.520008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a66b-084c-446a-ac09-de65f323cbcd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:44:04.533414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377a66b-084c-446a-ac09-de65f323cbcd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:44:04.538750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28634b-00f5-4a63-8486-e3278e37f697 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:44:04.539479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28634b-00f5-4a63-8486-e3278e37f697 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:04.539760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28634b-00f5-4a63-8486-e3278e37f697 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:04.540037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28634b-00f5-4a63-8486-e3278e37f697 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:04.548150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28634b-00f5-4a63-8486-e3278e37f697 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:44:04.549769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28634b-00f5-4a63-8486-e3278e37f697 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:44:04.559888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 753/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:44:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:44:06.186224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc779a-0908-4558-8b1a-4676005eb16f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:06.186799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc779a-0908-4558-8b1a-4676005eb16f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:06.186799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc779a-0908-4558-8b1a-4676005eb16f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:06.188235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:44:06.193092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e008b-f788-4db8-b1c5-da8cd20f36df None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:06.193501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e008b-f788-4db8-b1c5-da8cd20f36df None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:06.193685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e008b-f788-4db8-b1c5-da8cd20f36df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:06.211644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e81e008b-f788-4db8-b1c5-da8cd20f36df None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:44:06.212849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e81e008b-f788-4db8-b1c5-da8cd20f36df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:06.220805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:44:06.375466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc779a-0908-4558-8b1a-4676005eb16f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:44:06.390182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc779a-0908-4558-8b1a-4676005eb16f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:44:06.395535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de8c53-fca7-4084-a24a-aac68cbc4669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:44:06.396167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de8c53-fca7-4084-a24a-aac68cbc4669 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:06.396450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de8c53-fca7-4084-a24a-aac68cbc4669 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:06.396724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de8c53-fca7-4084-a24a-aac68cbc4669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:06.405787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de8c53-fca7-4084-a24a-aac68cbc4669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:44:06.407404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de8c53-fca7-4084-a24a-aac68cbc4669 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:44:06.418067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 770/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:44:07.244904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059e936-7216-4a86-a030-599d4ee4963c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:07.245464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059e936-7216-4a86-a030-599d4ee4963c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:07.245464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059e936-7216-4a86-a030-599d4ee4963c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:07.246824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 09:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:44:07.251670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19277bf2-fef0-4998-99c6-8b6f6c62ea78 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:07.252076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19277bf2-fef0-4998-99c6-8b6f6c62ea78 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:07.252237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19277bf2-fef0-4998-99c6-8b6f6c62ea78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:07.270635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-19277bf2-fef0-4998-99c6-8b6f6c62ea78 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:44:07.271855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-19277bf2-fef0-4998-99c6-8b6f6c62ea78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:07.279873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 09:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:44:07.433846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059e936-7216-4a86-a030-599d4ee4963c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:44:07.448006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059e936-7216-4a86-a030-599d4ee4963c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:44:07.453336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13dd5f-9cc8-42b1-b97a-05caad80da57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:44:07.453969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13dd5f-9cc8-42b1-b97a-05caad80da57 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:07.454249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13dd5f-9cc8-42b1-b97a-05caad80da57 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:07.454528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13dd5f-9cc8-42b1-b97a-05caad80da57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:07.462579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13dd5f-9cc8-42b1-b97a-05caad80da57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:44:07.464230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13dd5f-9cc8-42b1-b97a-05caad80da57 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:44:07.473507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 756/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:44:11.379437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6cb5f-07fe-4b01-8023-3a19860fdc19 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:11.380099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6cb5f-07fe-4b01-8023-3a19860fdc19 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:11.380099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6cb5f-07fe-4b01-8023-3a19860fdc19 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:11.381622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:44:11.387710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0106471-a33a-47ce-96a9-1d4ffb7785bd None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:11.388144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0106471-a33a-47ce-96a9-1d4ffb7785bd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:11.388281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0106471-a33a-47ce-96a9-1d4ffb7785bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:11.406788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e0106471-a33a-47ce-96a9-1d4ffb7785bd None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:44:11.408012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e0106471-a33a-47ce-96a9-1d4ffb7785bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:11.416220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:44:11.455970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6cb5f-07fe-4b01-8023-3a19860fdc19 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:44:11.457616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-75d6cb5f-07fe-4b01-8023-3a19860fdc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:11.514385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6cb5f-07fe-4b01-8023-3a19860fdc19 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:44:11.517849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e39a0f-d4a3-405a-8d0b-33a6a1faf80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:44:11.518485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e39a0f-d4a3-405a-8d0b-33a6a1faf80c service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:11.518767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e39a0f-d4a3-405a-8d0b-33a6a1faf80c service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:11.519072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e39a0f-d4a3-405a-8d0b-33a6a1faf80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:11.528348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e39a0f-d4a3-405a-8d0b-33a6a1faf80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:44:11.529776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e39a0f-d4a3-405a-8d0b-33a6a1faf80c service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:44:11.534998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:11.539775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 773/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:44:13.666029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041db37d-27e2-4e06-9a77-f375ed7a23bb None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:13.666546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041db37d-27e2-4e06-9a77-f375ed7a23bb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:13.666662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041db37d-27e2-4e06-9a77-f375ed7a23bb None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:13.667992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:44:13.673137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8bd9a-87ca-46aa-aa1f-21763d5c5c49 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:13.673542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8bd9a-87ca-46aa-aa1f-21763d5c5c49 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:13.673697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8bd9a-87ca-46aa-aa1f-21763d5c5c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:13.691319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-69d8bd9a-87ca-46aa-aa1f-21763d5c5c49 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:44:13.692494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-69d8bd9a-87ca-46aa-aa1f-21763d5c5c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:13.701071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:44:13.736885 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041db37d-27e2-4e06-9a77-f375ed7a23bb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:44:13.747401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041db37d-27e2-4e06-9a77-f375ed7a23bb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:44:13.751072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a239f0-3c05-47d6-9d7a-248c8cf30f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:44:13.751700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a239f0-3c05-47d6-9d7a-248c8cf30f4e service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:13.752239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a239f0-3c05-47d6-9d7a-248c8cf30f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:13.752519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a239f0-3c05-47d6-9d7a-248c8cf30f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:13.762057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a239f0-3c05-47d6-9d7a-248c8cf30f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:44:13.763526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a239f0-3c05-47d6-9d7a-248c8cf30f4e service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:44:13.773503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 759/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:44:17.409776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9f8ba-7950-4682-8509-73216ea2011f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:17.410340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9f8ba-7950-4682-8509-73216ea2011f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:17.410340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9f8ba-7950-4682-8509-73216ea2011f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:17.411756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:44:17.417679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cab133-68a4-4e4c-a390-728fe960d76c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:17.418104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cab133-68a4-4e4c-a390-728fe960d76c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:17.418210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cab133-68a4-4e4c-a390-728fe960d76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:17.436366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a3cab133-68a4-4e4c-a390-728fe960d76c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:44:17.437548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a3cab133-68a4-4e4c-a390-728fe960d76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:17.445393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:44:17.749167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9f8ba-7950-4682-8509-73216ea2011f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:44:17.750816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8ae9f8ba-7950-4682-8509-73216ea2011f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:17.808600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9f8ba-7950-4682-8509-73216ea2011f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:44:17.812204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f37c7-876d-4f16-9fc2-6b900c53ae1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:44:17.812846 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f37c7-876d-4f16-9fc2-6b900c53ae1d service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:17.813134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f37c7-876d-4f16-9fc2-6b900c53ae1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:17.813411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f37c7-876d-4f16-9fc2-6b900c53ae1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:17.822408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f37c7-876d-4f16-9fc2-6b900c53ae1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:44:17.823863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f37c7-876d-4f16-9fc2-6b900c53ae1d service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:44:17.833041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 776/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:44:19.896093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc89a-1c6f-4f05-87b0-dd7d4e5dce08 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:19.896623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc89a-1c6f-4f05-87b0-dd7d4e5dce08 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:19.896623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc89a-1c6f-4f05-87b0-dd7d4e5dce08 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:19.898951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 09:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:44:19.903994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5615d5-e0a4-45b9-a5c9-e51c2d8e37c5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:19.904440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5615d5-e0a4-45b9-a5c9-e51c2d8e37c5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:19.904579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5615d5-e0a4-45b9-a5c9-e51c2d8e37c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:19.923426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1e5615d5-e0a4-45b9-a5c9-e51c2d8e37c5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:44:19.924637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1e5615d5-e0a4-45b9-a5c9-e51c2d8e37c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:19.932562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 09:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:44:20.235169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc89a-1c6f-4f05-87b0-dd7d4e5dce08 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:44:20.236866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b3abc89a-1c6f-4f05-87b0-dd7d4e5dce08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:44:20.244557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=65 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:20.250186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc89a-1c6f-4f05-87b0-dd7d4e5dce08 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:44:20.253845 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b916a8-b268-42fe-b8ed-a698dc9d9f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:44:20.254860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b916a8-b268-42fe-b8ed-a698dc9d9f6a service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:44:20.254860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b916a8-b268-42fe-b8ed-a698dc9d9f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:44:20.255211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b916a8-b268-42fe-b8ed-a698dc9d9f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:44:20.265289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b916a8-b268-42fe-b8ed-a698dc9d9f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:44:20.266709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b916a8-b268-42fe-b8ed-a698dc9d9f6a service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:44:20.277434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 762/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:44:29.917948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=32 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:44:30.272495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:51.418469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d25e9-6b25-49c4-9976-9c79b1229508 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.420738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d25e9-6b25-49c4-9976-9c79b1229508 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.420738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710d25e9-6b25-49c4-9976-9c79b1229508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.446423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-710d25e9-6b25-49c4-9976-9c79b1229508 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:51.447743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-710d25e9-6b25-49c4-9976-9c79b1229508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:51.460454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 778/1540] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:51.471963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dac173-838d-4429-9e6c-2af6a602d84a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.472582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dac173-838d-4429-9e6c-2af6a602d84a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.472582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dac173-838d-4429-9e6c-2af6a602d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.500970 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-14dac173-838d-4429-9e6c-2af6a602d84a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:51.502226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-14dac173-838d-4429-9e6c-2af6a602d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:51.516775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6767f-3149-4a84-ac2c-d87f6306016d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.517141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6767f-3149-4a84-ac2c-d87f6306016d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.517348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6767f-3149-4a84-ac2c-d87f6306016d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.518456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 763/1541] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:51.523199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dac173-838d-4429-9e6c-2af6a602d84a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:51.534455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dac173-838d-4429-9e6c-2af6a602d84a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:51.546737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:51.547472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.547758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.548036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.548789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:45:51.549105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:51.550165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:45:51.550165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 09:45:51.550165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: Jun 24 09:45:51.551121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:51.556049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-aef6767f-3149-4a84-ac2c-d87f6306016d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:51.557405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-aef6767f-3149-4a84-ac2c-d87f6306016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:51.574021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 764/1542] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:45:51.585718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 779/1543] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:45:51.589276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:51.600935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce13b00-892e-4ec2-ae4e-980d156e16c5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.601240 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce13b00-892e-4ec2-ae4e-980d156e16c5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.601527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce13b00-892e-4ec2-ae4e-980d156e16c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.619627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7c777-55b9-47f0-ae48-ff3773a468f2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:51.638772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2a8b3-bbe3-4055-97eb-af251c4dc30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:51.639210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2ce13b00-892e-4ec2-ae4e-980d156e16c5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:51.639494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2a8b3-bbe3-4055-97eb-af251c4dc30a admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.639779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2a8b3-bbe3-4055-97eb-af251c4dc30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.640058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2a8b3-bbe3-4055-97eb-af251c4dc30a admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.640445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2ce13b00-892e-4ec2-ae4e-980d156e16c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:51.641019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2a8b3-bbe3-4055-97eb-af251c4dc30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:51.643006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2a8b3-bbe3-4055-97eb-af251c4dc30a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:51.673590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 780/1544] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:51.674939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb46792-00f9-49c8-a9ae-56e40a881f76 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.675236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb46792-00f9-49c8-a9ae-56e40a881f76 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.675521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb46792-00f9-49c8-a9ae-56e40a881f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.701093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6cb46792-00f9-49c8-a9ae-56e40a881f76 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:51.705059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6cb46792-00f9-49c8-a9ae-56e40a881f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:51.721698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 781/1545] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:51.722566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb46792-00f9-49c8-a9ae-56e40a881f76 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:51.736452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb46792-00f9-49c8-a9ae-56e40a881f76 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:51.745788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016275b-0a36-4041-8a34-2c016c05aae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:51.748350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016275b-0a36-4041-8a34-2c016c05aae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.748350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016275b-0a36-4041-8a34-2c016c05aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.748350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016275b-0a36-4041-8a34-2c016c05aae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.748350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016275b-0a36-4041-8a34-2c016c05aae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:45:51.748350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016275b-0a36-4041-8a34-2c016c05aae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:51.749751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016275b-0a36-4041-8a34-2c016c05aae0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:51.777794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 782/1546] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:45:51.783080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0a83-d212-4929-bf4e-302fb20b8957 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.783693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0a83-d212-4929-bf4e-302fb20b8957 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.783986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf0a83-d212-4929-bf4e-302fb20b8957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.788006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 765/1547] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/projects => generated 393 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:51.789432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1fec-0fa2-4393-907c-1dbbfa5981bb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.789736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1fec-0fa2-4393-907c-1dbbfa5981bb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.790024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f1fec-0fa2-4393-907c-1dbbfa5981bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.810122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a9cf0a83-d212-4929-bf4e-302fb20b8957 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:51.811418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a9cf0a83-d212-4929-bf4e-302fb20b8957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:51.827787 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-856f1fec-0fa2-4393-907c-1dbbfa5981bb None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:51.829001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-856f1fec-0fa2-4393-907c-1dbbfa5981bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:51.893360 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 783/1548] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:51.894705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e841405-205d-4e14-b385-db609cd16ddd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.895025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e841405-205d-4e14-b385-db609cd16ddd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.895418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e841405-205d-4e14-b385-db609cd16ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.909379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 766/1549] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:51.911564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1fec-0fa2-4393-907c-1dbbfa5981bb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:51.920410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4e841405-205d-4e14-b385-db609cd16ddd None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:51.921735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f1fec-0fa2-4393-907c-1dbbfa5981bb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:51.921858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4e841405-205d-4e14-b385-db609cd16ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:51.926353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0a048-ed3c-4b97-ac2b-bac685068adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:51.927022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0a048-ed3c-4b97-ac2b-bac685068adc admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.927311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0a048-ed3c-4b97-ac2b-bac685068adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.927629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0a048-ed3c-4b97-ac2b-bac685068adc admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.928329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0a048-ed3c-4b97-ac2b-bac685068adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:51.929859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 784/1550] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:51.930296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0a048-ed3c-4b97-ac2b-bac685068adc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:51.930618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e841405-205d-4e14-b385-db609cd16ddd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:51.941228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e841405-205d-4e14-b385-db609cd16ddd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:51.945986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b0b26-e73b-4093-9a16-e070ed8b97fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:51.946657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0b26-e73b-4093-9a16-e070ed8b97fa admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:51.947487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0b26-e73b-4093-9a16-e070ed8b97fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:51.947746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0b26-e73b-4093-9a16-e070ed8b97fa admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:51.948441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b0b26-e73b-4093-9a16-e070ed8b97fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:51.950474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b0b26-e73b-4093-9a16-e070ed8b97fa admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.004796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 767/1551] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:52.006249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f14e5-522b-4a1f-9e00-009b2e52f8ca None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.006530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f14e5-522b-4a1f-9e00-009b2e52f8ca None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.006811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f14e5-522b-4a1f-9e00-009b2e52f8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.026717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-836f14e5-522b-4a1f-9e00-009b2e52f8ca None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:52.027942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-836f14e5-522b-4a1f-9e00-009b2e52f8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:52.061715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 785/1552] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:51 2022] POST /identity/v3/users => generated 297 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:52.063026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a256e54-60fe-4908-bd1a-96fa1a00e5d4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.063319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a256e54-60fe-4908-bd1a-96fa1a00e5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.063597 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a256e54-60fe-4908-bd1a-96fa1a00e5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.082800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6a256e54-60fe-4908-bd1a-96fa1a00e5d4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:52.087280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6a256e54-60fe-4908-bd1a-96fa1a00e5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:52.088634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 768/1553] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:52.089812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d508c-4659-44b3-83eb-ff2708e0136c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.090059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d508c-4659-44b3-83eb-ff2708e0136c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.090342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d508c-4659-44b3-83eb-ff2708e0136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.092409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 786/1554] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:52.093014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a256e54-60fe-4908-bd1a-96fa1a00e5d4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.103964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a256e54-60fe-4908-bd1a-96fa1a00e5d4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.108574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c74783-3359-4232-b6a3-6653a4f306a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.112385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c74783-3359-4232-b6a3-6653a4f306a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.112385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c74783-3359-4232-b6a3-6653a4f306a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.112385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c74783-3359-4232-b6a3-6653a4f306a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.112385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c74783-3359-4232-b6a3-6653a4f306a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:45:52.112385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c74783-3359-4232-b6a3-6653a4f306a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.112385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c74783-3359-4232-b6a3-6653a4f306a5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.116955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9a4d508c-4659-44b3-83eb-ff2708e0136c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:52.118213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9a4d508c-4659-44b3-83eb-ff2708e0136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:52.124709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 787/1555] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:45:52.126149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326164-a759-43d2-baf5-913efff5e8e3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.126558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326164-a759-43d2-baf5-913efff5e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.126949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326164-a759-43d2-baf5-913efff5e8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.131111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 769/1556] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:52.131111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362758-f40c-41f8-87cc-dc5abacdc368 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.131111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362758-f40c-41f8-87cc-dc5abacdc368 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.131111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6362758-f40c-41f8-87cc-dc5abacdc368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.149480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e6362758-f40c-41f8-87cc-dc5abacdc368 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:52.150819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e6362758-f40c-41f8-87cc-dc5abacdc368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:52.153961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-53326164-a759-43d2-baf5-913efff5e8e3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:52.155165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-53326164-a759-43d2-baf5-913efff5e8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:52.159030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 770/1557] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:52.163503 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 788/1558] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:52.163787 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362758-f40c-41f8-87cc-dc5abacdc368 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.167760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326164-a759-43d2-baf5-913efff5e8e3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.174052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6362758-f40c-41f8-87cc-dc5abacdc368 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.177482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326164-a759-43d2-baf5-913efff5e8e3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.178628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907806f9-b552-4349-8060-ecc428e92199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.179315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907806f9-b552-4349-8060-ecc428e92199 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.179596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907806f9-b552-4349-8060-ecc428e92199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.179871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907806f9-b552-4349-8060-ecc428e92199 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.180553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907806f9-b552-4349-8060-ecc428e92199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.182737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-907806f9-b552-4349-8060-ecc428e92199 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:45:52.182737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 09:45:52.182737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: Jun 24 09:45:52.183987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc44046-90d3-4470-b386-9df2bf98aac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.184132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907806f9-b552-4349-8060-ecc428e92199 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.184659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44046-90d3-4470-b386-9df2bf98aac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.184945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44046-90d3-4470-b386-9df2bf98aac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.185459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc44046-90d3-4470-b386-9df2bf98aac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.185958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc44046-90d3-4470-b386-9df2bf98aac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.187566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc44046-90d3-4470-b386-9df2bf98aac6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.198741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 789/1559] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:52.199984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e62c7-a46c-4cd7-83f5-3994b15d189c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.200274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e62c7-a46c-4cd7-83f5-3994b15d189c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.200555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e62c7-a46c-4cd7-83f5-3994b15d189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.217738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-328e62c7-a46c-4cd7-83f5-3994b15d189c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:52.218975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-328e62c7-a46c-4cd7-83f5-3994b15d189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:52.226788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 790/1560] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:52.227958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5024-1dcc-477b-b701-0384871e8bd3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.228455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5024-1dcc-477b-b701-0384871e8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.228455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e5024-1dcc-477b-b701-0384871e8bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.246413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7e0e5024-1dcc-477b-b701-0384871e8bd3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:52.250725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7e0e5024-1dcc-477b-b701-0384871e8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:52.255676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 791/1561] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:52.256416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5024-1dcc-477b-b701-0384871e8bd3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.266048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e5024-1dcc-477b-b701-0384871e8bd3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.270485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c0df4-5f18-4157-a8cb-c23be0ab3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.271140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c0df4-5f18-4157-a8cb-c23be0ab3fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.271423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c0df4-5f18-4157-a8cb-c23be0ab3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.271699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c0df4-5f18-4157-a8cb-c23be0ab3fc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.272394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c0df4-5f18-4157-a8cb-c23be0ab3fc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:45:52.272699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c0df4-5f18-4157-a8cb-c23be0ab3fc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.274269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c0df4-5f18-4157-a8cb-c23be0ab3fc3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.293292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 792/1562] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:45:52.293292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c0df4-5f18-4157-a8cb-c23be0ab3fc3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.293632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 771/1563] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:52.293632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907806f9-b552-4349-8060-ecc428e92199 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.297780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c0df4-5f18-4157-a8cb-c23be0ab3fc3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.300898 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907806f9-b552-4349-8060-ecc428e92199 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.302938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe431803-4f63-420f-b4cc-5d96caad4558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.303584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe431803-4f63-420f-b4cc-5d96caad4558 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.303866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe431803-4f63-420f-b4cc-5d96caad4558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.304041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f272b-f700-4e5c-96d2-5ad36d79cb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.304163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe431803-4f63-420f-b4cc-5d96caad4558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.304703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f272b-f700-4e5c-96d2-5ad36d79cb0b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.304922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe431803-4f63-420f-b4cc-5d96caad4558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.305041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f272b-f700-4e5c-96d2-5ad36d79cb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.305252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f272b-f700-4e5c-96d2-5ad36d79cb0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.305921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-fe431803-4f63-420f-b4cc-5d96caad4558 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:45:52.305921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 09:45:52.305921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: Jun 24 09:45:52.306204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f272b-f700-4e5c-96d2-5ad36d79cb0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:45:52.306952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f272b-f700-4e5c-96d2-5ad36d79cb0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.307681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe431803-4f63-420f-b4cc-5d96caad4558 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.308541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f272b-f700-4e5c-96d2-5ad36d79cb0b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.310160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:52.321121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 772/1564] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:45:52.323070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b2a6e-1ecf-4d8b-8a18-464be879add4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.325345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b2a6e-1ecf-4d8b-8a18-464be879add4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.325345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b2a6e-1ecf-4d8b-8a18-464be879add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.340694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-860b2a6e-1ecf-4d8b-8a18-464be879add4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:52.341882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-860b2a6e-1ecf-4d8b-8a18-464be879add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:52.350303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 773/1565] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:52.351094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b2a6e-1ecf-4d8b-8a18-464be879add4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.361069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b2a6e-1ecf-4d8b-8a18-464be879add4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.365507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30758166-126e-425f-a294-73a8108c2f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.366135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30758166-126e-425f-a294-73a8108c2f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.366420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30758166-126e-425f-a294-73a8108c2f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.366696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30758166-126e-425f-a294-73a8108c2f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.367438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30758166-126e-425f-a294-73a8108c2f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.370037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30758166-126e-425f-a294-73a8108c2f23 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.379497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 774/1566] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:52.380919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30758166-126e-425f-a294-73a8108c2f23 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.390791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30758166-126e-425f-a294-73a8108c2f23 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.395299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9876e-bfa8-4329-ba18-a6b23f018fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.400165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9876e-bfa8-4329-ba18-a6b23f018fac admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.400165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9876e-bfa8-4329-ba18-a6b23f018fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.400165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9876e-bfa8-4329-ba18-a6b23f018fac admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.400165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9876e-bfa8-4329-ba18-a6b23f018fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:45:52.400165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9876e-bfa8-4329-ba18-a6b23f018fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.400165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9876e-bfa8-4329-ba18-a6b23f018fac admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.403728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 793/1567] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:52.404563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe431803-4f63-420f-b4cc-5d96caad4558 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.412014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 775/1568] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:45:52.412869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9876e-bfa8-4329-ba18-a6b23f018fac admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.423036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9876e-bfa8-4329-ba18-a6b23f018fac admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.424337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:52.472864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe431803-4f63-420f-b4cc-5d96caad4558 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.477405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3351-f21d-4701-86bf-92b62d50078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.478071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3351-f21d-4701-86bf-92b62d50078d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.478892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3351-f21d-4701-86bf-92b62d50078d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.479174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3351-f21d-4701-86bf-92b62d50078d admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.479899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3351-f21d-4701-86bf-92b62d50078d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:45:52.480267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3351-f21d-4701-86bf-92b62d50078d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.480526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cbe8e-c5dc-42d6-b9e3-759216b553ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.481188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cbe8e-c5dc-42d6-b9e3-759216b553ac admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.481472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cbe8e-c5dc-42d6-b9e3-759216b553ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.481748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7cbe8e-c5dc-42d6-b9e3-759216b553ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.481855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3351-f21d-4701-86bf-92b62d50078d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.482430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cbe8e-c5dc-42d6-b9e3-759216b553ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.484361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7cbe8e-c5dc-42d6-b9e3-759216b553ac admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.496205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 794/1569] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:45:52.502245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3351-f21d-4701-86bf-92b62d50078d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.506683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3351-f21d-4701-86bf-92b62d50078d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.512341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6d4e7-035e-4f50-b739-c51e418e8895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.513075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6d4e7-035e-4f50-b739-c51e418e8895 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.513362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6d4e7-035e-4f50-b739-c51e418e8895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.513639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6d4e7-035e-4f50-b739-c51e418e8895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.514352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6d4e7-035e-4f50-b739-c51e418e8895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.515949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6d4e7-035e-4f50-b739-c51e418e8895 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.526473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 795/1570] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:52.527242 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6d4e7-035e-4f50-b739-c51e418e8895 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.536155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6d4e7-035e-4f50-b739-c51e418e8895 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.540555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23dff8-cfd0-4c11-86c4-b8997e3057ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.542207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23dff8-cfd0-4c11-86c4-b8997e3057ec admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.542496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23dff8-cfd0-4c11-86c4-b8997e3057ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.542777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23dff8-cfd0-4c11-86c4-b8997e3057ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.543473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23dff8-cfd0-4c11-86c4-b8997e3057ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.545291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23dff8-cfd0-4c11-86c4-b8997e3057ec admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.613736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 776/1571] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:52.613736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cbe8e-c5dc-42d6-b9e3-759216b553ac admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.640156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 796/1572] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:52.644389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23dff8-cfd0-4c11-86c4-b8997e3057ec admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.675015 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7cbe8e-c5dc-42d6-b9e3-759216b553ac admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.709226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23dff8-cfd0-4c11-86c4-b8997e3057ec admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.714772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7b2de-cc04-4207-a90e-cabde04f4735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.715709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7b2de-cc04-4207-a90e-cabde04f4735 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.715992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7b2de-cc04-4207-a90e-cabde04f4735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.716265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7b2de-cc04-4207-a90e-cabde04f4735 admin admin] PATH_INFO: `/v3/projects/afce7b92558e4afc9805f7b1ee69c862/users/2cdef290abf8487ab370969a5e5b76c5/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.725638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:52.731364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7b2de-cc04-4207-a90e-cabde04f4735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afce7b92558e4afc9805f7b1ee69c862, user_id=2cdef290abf8487ab370969a5e5b76c5, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.737440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-7db7b2de-cc04-4207-a90e-cabde04f4735 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:45:52.737440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 09:45:52.737440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: Jun 24 09:45:52.737890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c2a97-29b5-40c9-9f02-d185015fae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.737890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2a97-29b5-40c9-9f02-d185015fae2a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.737890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2a97-29b5-40c9-9f02-d185015fae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.738170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7b2de-cc04-4207-a90e-cabde04f4735 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.738270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2a97-29b5-40c9-9f02-d185015fae2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.738270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c2a97-29b5-40c9-9f02-d185015fae2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:45:52.738270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c2a97-29b5-40c9-9f02-d185015fae2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.738270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c2a97-29b5-40c9-9f02-d185015fae2a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.748965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 777/1573] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:45:52.749902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c2a97-29b5-40c9-9f02-d185015fae2a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.760736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c2a97-29b5-40c9-9f02-d185015fae2a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.765317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccd258-2a18-40b5-9e46-ec0e22990450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.765986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccd258-2a18-40b5-9e46-ec0e22990450 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.766279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccd258-2a18-40b5-9e46-ec0e22990450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.766560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccd258-2a18-40b5-9e46-ec0e22990450 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.767272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccd258-2a18-40b5-9e46-ec0e22990450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.769214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccd258-2a18-40b5-9e46-ec0e22990450 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.838624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 797/1574] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:52 2022] PUT /identity/v3/projects/afce7b92558e4afc9805f7b1ee69c862/users/2cdef290abf8487ab370969a5e5b76c5/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:52.839461 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7b2de-cc04-4207-a90e-cabde04f4735 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.864808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 778/1575] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/users => generated 303 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:52.864808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccd258-2a18-40b5-9e46-ec0e22990450 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:52.872616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccd258-2a18-40b5-9e46-ec0e22990450 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.897156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:52.903206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7b2de-cc04-4207-a90e-cabde04f4735 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:52.907823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ef49f-e7b8-4f8d-8c51-c8521e47236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.908481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ef49f-e7b8-4f8d-8c51-c8521e47236c admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.908763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ef49f-e7b8-4f8d-8c51-c8521e47236c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.909047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ef49f-e7b8-4f8d-8c51-c8521e47236c admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.909732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ef49f-e7b8-4f8d-8c51-c8521e47236c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.911735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ef49f-e7b8-4f8d-8c51-c8521e47236c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.931119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1880ee9-e962-4b17-a2d2-0b573c3cfeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:52.931825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880ee9-e962-4b17-a2d2-0b573c3cfeca admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:52.932183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880ee9-e962-4b17-a2d2-0b573c3cfeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:52.932467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1880ee9-e962-4b17-a2d2-0b573c3cfeca admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:52.933161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1880ee9-e962-4b17-a2d2-0b573c3cfeca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:52.935109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1880ee9-e962-4b17-a2d2-0b573c3cfeca admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:52.993279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 798/1576] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:52.994291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ef49f-e7b8-4f8d-8c51-c8521e47236c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.017706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 779/1577] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:52 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:53.017706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1880ee9-e962-4b17-a2d2-0b573c3cfeca admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.059355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ef49f-e7b8-4f8d-8c51-c8521e47236c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.085196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1880ee9-e962-4b17-a2d2-0b573c3cfeca admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.090918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af695eec-eadd-435d-8f08-27127682c607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.091584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af695eec-eadd-435d-8f08-27127682c607 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.092234 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af695eec-eadd-435d-8f08-27127682c607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.092520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af695eec-eadd-435d-8f08-27127682c607 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.093210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af695eec-eadd-435d-8f08-27127682c607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.095168 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af695eec-eadd-435d-8f08-27127682c607 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.117009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4091c6f-f831-4632-9d5a-2ff5796b6972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.117685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4091c6f-f831-4632-9d5a-2ff5796b6972 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.117973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4091c6f-f831-4632-9d5a-2ff5796b6972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.118257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4091c6f-f831-4632-9d5a-2ff5796b6972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.119053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4091c6f-f831-4632-9d5a-2ff5796b6972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.120667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4091c6f-f831-4632-9d5a-2ff5796b6972 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.130256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 799/1578] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.130256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4091c6f-f831-4632-9d5a-2ff5796b6972 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.140949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4091c6f-f831-4632-9d5a-2ff5796b6972 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.145515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc9e11-a966-4f65-968a-ec30eccbe8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.146133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc9e11-a966-4f65-968a-ec30eccbe8cf admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.146428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc9e11-a966-4f65-968a-ec30eccbe8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.146704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc9e11-a966-4f65-968a-ec30eccbe8cf admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.147396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc9e11-a966-4f65-968a-ec30eccbe8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.149275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc9e11-a966-4f65-968a-ec30eccbe8cf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.184148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 780/1579] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:53 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:53.184148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af695eec-eadd-435d-8f08-27127682c607 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.192670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af695eec-eadd-435d-8f08-27127682c607 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.197708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bda8c0-e0f9-4f91-81f3-d3d09582383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.198349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bda8c0-e0f9-4f91-81f3-d3d09582383f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.198633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bda8c0-e0f9-4f91-81f3-d3d09582383f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.198938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bda8c0-e0f9-4f91-81f3-d3d09582383f admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.199622 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bda8c0-e0f9-4f91-81f3-d3d09582383f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.201511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bda8c0-e0f9-4f91-81f3-d3d09582383f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.261975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 800/1580] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:53 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:53.263198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84626d3-af71-4d72-8883-039aeba2337d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.263487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84626d3-af71-4d72-8883-039aeba2337d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.263764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84626d3-af71-4d72-8883-039aeba2337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.281453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b84626d3-af71-4d72-8883-039aeba2337d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:53.282712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b84626d3-af71-4d72-8883-039aeba2337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:53.290484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 801/1581] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:53.294399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 781/1582] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:53 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:53.295109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84626d3-af71-4d72-8883-039aeba2337d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.295220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bda8c0-e0f9-4f91-81f3-d3d09582383f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.308814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84626d3-af71-4d72-8883-039aeba2337d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.320344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:53.356263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bda8c0-e0f9-4f91-81f3-d3d09582383f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.361138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a776a-b29f-41b9-8514-90d4317306ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.361793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a776a-b29f-41b9-8514-90d4317306ad admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.362088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a776a-b29f-41b9-8514-90d4317306ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.362707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a776a-b29f-41b9-8514-90d4317306ad admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.363588 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a776a-b29f-41b9-8514-90d4317306ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.365531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323c4e9-6570-48cf-af09-cc8a46f22eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.366199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323c4e9-6570-48cf-af09-cc8a46f22eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.366368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a776a-b29f-41b9-8514-90d4317306ad admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.366484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323c4e9-6570-48cf-af09-cc8a46f22eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.366768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323c4e9-6570-48cf-af09-cc8a46f22eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.367495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323c4e9-6570-48cf-af09-cc8a46f22eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.369299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323c4e9-6570-48cf-af09-cc8a46f22eb9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.374371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:53.380154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 802/1583] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.380990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323c4e9-6570-48cf-af09-cc8a46f22eb9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.391209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323c4e9-6570-48cf-af09-cc8a46f22eb9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.395768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7443c0-b50f-4abe-8056-a14609235fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.396399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7443c0-b50f-4abe-8056-a14609235fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.396685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7443c0-b50f-4abe-8056-a14609235fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.396964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7443c0-b50f-4abe-8056-a14609235fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.397640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7443c0-b50f-4abe-8056-a14609235fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.399607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7443c0-b50f-4abe-8056-a14609235fe4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.493590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 782/1584] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:53 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:53.495075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a776a-b29f-41b9-8514-90d4317306ad admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.504961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a776a-b29f-41b9-8514-90d4317306ad admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.510099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72ad66-c5c0-4219-9b3c-eec16b8d5d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.511092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72ad66-c5c0-4219-9b3c-eec16b8d5d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.511387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72ad66-c5c0-4219-9b3c-eec16b8d5d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.511648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72ad66-c5c0-4219-9b3c-eec16b8d5d04 admin admin] PATH_INFO: `/v3/projects/da3a79914e604cff98a807078e5ac5bc/users/14a3d01823994fe09597417e6481246b/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.525372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 803/1585] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:53 2022] POST /identity/v3/users => generated 283 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:53.525372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7443c0-b50f-4abe-8056-a14609235fe4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.528987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7443c0-b50f-4abe-8056-a14609235fe4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.529216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72ad66-c5c0-4219-9b3c-eec16b8d5d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3a79914e604cff98a807078e5ac5bc, user_id=14a3d01823994fe09597417e6481246b, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.531798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72ad66-c5c0-4219-9b3c-eec16b8d5d04 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.533654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2612-58e1-47d3-8800-9e78801a50ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.534315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2612-58e1-47d3-8800-9e78801a50ca admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.534603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2612-58e1-47d3-8800-9e78801a50ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.534974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c2612-58e1-47d3-8800-9e78801a50ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.535705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c2612-58e1-47d3-8800-9e78801a50ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.537282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c2612-58e1-47d3-8800-9e78801a50ca admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.547824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 804/1586] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.548604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2612-58e1-47d3-8800-9e78801a50ca admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.558318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c2612-58e1-47d3-8800-9e78801a50ca admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.562998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c4187-e43d-43e1-acca-e681458937e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.563627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4187-e43d-43e1-acca-e681458937e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.563913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4187-e43d-43e1-acca-e681458937e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.564222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c4187-e43d-43e1-acca-e681458937e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.564919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c4187-e43d-43e1-acca-e681458937e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.566456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c4187-e43d-43e1-acca-e681458937e0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.578998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 805/1587] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.578998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c4187-e43d-43e1-acca-e681458937e0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.587172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c4187-e43d-43e1-acca-e681458937e0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.593859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1f1cc-ba58-432b-8c31-2c2eb244bf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.594512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1f1cc-ba58-432b-8c31-2c2eb244bf8f admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.594799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1f1cc-ba58-432b-8c31-2c2eb244bf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.595109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1f1cc-ba58-432b-8c31-2c2eb244bf8f admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.595973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1f1cc-ba58-432b-8c31-2c2eb244bf8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.597684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1f1cc-ba58-432b-8c31-2c2eb244bf8f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.613604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 783/1588] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:53 2022] PUT /identity/v3/projects/da3a79914e604cff98a807078e5ac5bc/users/14a3d01823994fe09597417e6481246b/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:53.614565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72ad66-c5c0-4219-9b3c-eec16b8d5d04 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.674653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72ad66-c5c0-4219-9b3c-eec16b8d5d04 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.678359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9fe25-a404-4277-8d1e-f4c896b32b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.679044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9fe25-a404-4277-8d1e-f4c896b32b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.679333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9fe25-a404-4277-8d1e-f4c896b32b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.679615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9fe25-a404-4277-8d1e-f4c896b32b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.684374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 806/1589] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:53 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:53.685412 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1f1cc-ba58-432b-8c31-2c2eb244bf8f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.695155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1f1cc-ba58-432b-8c31-2c2eb244bf8f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.744599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9fe25-a404-4277-8d1e-f4c896b32b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.746063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9fe25-a404-4277-8d1e-f4c896b32b4d service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.752245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927ba1-04f3-4e10-b4dc-99f46b962d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.752911 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927ba1-04f3-4e10-b4dc-99f46b962d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.753195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927ba1-04f3-4e10-b4dc-99f46b962d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.753498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02927ba1-04f3-4e10-b4dc-99f46b962d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.754215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02927ba1-04f3-4e10-b4dc-99f46b962d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.755828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02927ba1-04f3-4e10-b4dc-99f46b962d73 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.756001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 784/1590] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:45:53.756750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9fe25-a404-4277-8d1e-f4c896b32b4d service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.766454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9fe25-a404-4277-8d1e-f4c896b32b4d service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.770797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 807/1591] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.770797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927ba1-04f3-4e10-b4dc-99f46b962d73 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.773899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f959e-6d6a-4ebb-b5ad-4ff4c05b9b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.774565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f959e-6d6a-4ebb-b5ad-4ff4c05b9b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.774880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f959e-6d6a-4ebb-b5ad-4ff4c05b9b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.775220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f959e-6d6a-4ebb-b5ad-4ff4c05b9b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.776022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f959e-6d6a-4ebb-b5ad-4ff4c05b9b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.777631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f959e-6d6a-4ebb-b5ad-4ff4c05b9b69 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.779046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02927ba1-04f3-4e10-b4dc-99f46b962d73 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.784334 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbbb25-05e6-40ff-bb11-1bdd2fe86d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.784991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbbb25-05e6-40ff-bb11-1bdd2fe86d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.785277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbbb25-05e6-40ff-bb11-1bdd2fe86d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.785605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbbb25-05e6-40ff-bb11-1bdd2fe86d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.786320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbbb25-05e6-40ff-bb11-1bdd2fe86d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.787933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbbb25-05e6-40ff-bb11-1bdd2fe86d80 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.790308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 785/1592] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.790308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f959e-6d6a-4ebb-b5ad-4ff4c05b9b69 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.799967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f959e-6d6a-4ebb-b5ad-4ff4c05b9b69 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.801022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 808/1593] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.801873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbbb25-05e6-40ff-bb11-1bdd2fe86d80 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.808300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bce65a-f0a2-47e8-b55a-dab97c1ed800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.808975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bce65a-f0a2-47e8-b55a-dab97c1ed800 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.809264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bce65a-f0a2-47e8-b55a-dab97c1ed800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.809542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bce65a-f0a2-47e8-b55a-dab97c1ed800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.810286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bce65a-f0a2-47e8-b55a-dab97c1ed800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.811963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bce65a-f0a2-47e8-b55a-dab97c1ed800 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.812421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbbb25-05e6-40ff-bb11-1bdd2fe86d80 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.819285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d94eb-ee59-43a2-a79a-030b35f7ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.820409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d94eb-ee59-43a2-a79a-030b35f7ab53 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.820751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d94eb-ee59-43a2-a79a-030b35f7ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.821035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d94eb-ee59-43a2-a79a-030b35f7ab53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.821759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d94eb-ee59-43a2-a79a-030b35f7ab53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.824147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d94eb-ee59-43a2-a79a-030b35f7ab53 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.825922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 786/1594] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.827046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76a20c-12ab-4bed-acac-be5160e3540f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.827342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76a20c-12ab-4bed-acac-be5160e3540f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.827627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76a20c-12ab-4bed-acac-be5160e3540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.835625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 809/1595] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.841799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d94eb-ee59-43a2-a79a-030b35f7ab53 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.847423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d94eb-ee59-43a2-a79a-030b35f7ab53 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.852097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04654a1e-f353-4162-9e29-211d76215195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.852828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04654a1e-f353-4162-9e29-211d76215195 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.853727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04654a1e-f353-4162-9e29-211d76215195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.854155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04654a1e-f353-4162-9e29-211d76215195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.854912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04654a1e-f353-4162-9e29-211d76215195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.855506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8c76a20c-12ab-4bed-acac-be5160e3540f None None] MFA Rules not processed for user `14a3d01823994fe09597417e6481246b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:53.856500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04654a1e-f353-4162-9e29-211d76215195 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.856703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8c76a20c-12ab-4bed-acac-be5160e3540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:53.866102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:53.866983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 810/1596] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.867898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04654a1e-f353-4162-9e29-211d76215195 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.878068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04654a1e-f353-4162-9e29-211d76215195 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.887659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd042-edb5-4df0-b028-dcbf7eb4f0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.888561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd042-edb5-4df0-b028-dcbf7eb4f0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.888848 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd042-edb5-4df0-b028-dcbf7eb4f0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.889129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddd042-edb5-4df0-b028-dcbf7eb4f0f2 admin admin] PATH_INFO: `/v3/projects/4f3b533ed21a430b926f90f84f291269/users/2e90e00230bf4a49bf80366bab518798/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.904582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddd042-edb5-4df0-b028-dcbf7eb4f0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3b533ed21a430b926f90f84f291269, user_id=2e90e00230bf4a49bf80366bab518798, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.907387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddd042-edb5-4df0-b028-dcbf7eb4f0f2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.936608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 787/1597] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:53.937456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76a20c-12ab-4bed-acac-be5160e3540f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.951017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76a20c-12ab-4bed-acac-be5160e3540f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.955839 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a522328-bf71-4299-9493-d45c3248554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:53.959176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a522328-bf71-4299-9493-d45c3248554c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:53.959176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a522328-bf71-4299-9493-d45c3248554c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:53.959176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a522328-bf71-4299-9493-d45c3248554c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:53.959176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a522328-bf71-4299-9493-d45c3248554c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:53.959526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a522328-bf71-4299-9493-d45c3248554c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:53.969650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 788/1598] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:53.970492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a522328-bf71-4299-9493-d45c3248554c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:53.980862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a522328-bf71-4299-9493-d45c3248554c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:53.982886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 811/1599] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:53 2022] PUT /identity/v3/projects/4f3b533ed21a430b926f90f84f291269/users/2e90e00230bf4a49bf80366bab518798/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:53.983689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd042-edb5-4df0-b028-dcbf7eb4f0f2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.025712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:54.040413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80223a9-2dc0-4d25-b466-cf1b5bf1ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.041615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80223a9-2dc0-4d25-b466-cf1b5bf1ad94 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.041902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80223a9-2dc0-4d25-b466-cf1b5bf1ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.042182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80223a9-2dc0-4d25-b466-cf1b5bf1ad94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.042938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80223a9-2dc0-4d25-b466-cf1b5bf1ad94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.044535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80223a9-2dc0-4d25-b466-cf1b5bf1ad94 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.047193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddd042-edb5-4df0-b028-dcbf7eb4f0f2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.051924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288de33-008b-42e4-89ae-e95bb069f96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.052818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288de33-008b-42e4-89ae-e95bb069f96b admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.053106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288de33-008b-42e4-89ae-e95bb069f96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.053395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288de33-008b-42e4-89ae-e95bb069f96b admin admin] PATH_INFO: `/v3/projects/a2f5d88804e34f4399572543f1674264/users/4a762aa672f5465da0f7cbc67ea7af9b/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.054192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 789/1600] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:54.054922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80223a9-2dc0-4d25-b466-cf1b5bf1ad94 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.067137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80223a9-2dc0-4d25-b466-cf1b5bf1ad94 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.068928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288de33-008b-42e4-89ae-e95bb069f96b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f5d88804e34f4399572543f1674264, user_id=4a762aa672f5465da0f7cbc67ea7af9b, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.072638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086fd63-a6a5-47e3-8b5f-fe875e7ab9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.073133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288de33-008b-42e4-89ae-e95bb069f96b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.073704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086fd63-a6a5-47e3-8b5f-fe875e7ab9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.074119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086fd63-a6a5-47e3-8b5f-fe875e7ab9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.074400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086fd63-a6a5-47e3-8b5f-fe875e7ab9aa admin admin] PATH_INFO: `/v3/projects/ab0a9ec4d2f74272a44f3d4ac22dd89a/users/38331c36830a426cbc41b370c707e44c/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.091490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086fd63-a6a5-47e3-8b5f-fe875e7ab9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0a9ec4d2f74272a44f3d4ac22dd89a, user_id=38331c36830a426cbc41b370c707e44c, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.094297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d086fd63-a6a5-47e3-8b5f-fe875e7ab9aa admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.181006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 790/1601] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:54 2022] PUT /identity/v3/projects/ab0a9ec4d2f74272a44f3d4ac22dd89a/users/38331c36830a426cbc41b370c707e44c/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:54.182057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 812/1602] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:53 2022] PUT /identity/v3/projects/a2f5d88804e34f4399572543f1674264/users/4a762aa672f5465da0f7cbc67ea7af9b/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:54.182212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086fd63-a6a5-47e3-8b5f-fe875e7ab9aa admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.182583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288de33-008b-42e4-89ae-e95bb069f96b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.250406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086fd63-a6a5-47e3-8b5f-fe875e7ab9aa admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.252922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288de33-008b-42e4-89ae-e95bb069f96b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.255607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0e9c-f0c4-4d15-9797-d0759e61c5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.256562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0e9c-f0c4-4d15-9797-d0759e61c5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.256870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0e9c-f0c4-4d15-9797-d0759e61c5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.257126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0e9c-f0c4-4d15-9797-d0759e61c5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.257652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951810a-8eff-4414-8f4e-8fddf9b784d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.257856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0e9c-f0c4-4d15-9797-d0759e61c5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.258315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951810a-8eff-4414-8f4e-8fddf9b784d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.258608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951810a-8eff-4414-8f4e-8fddf9b784d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.258921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951810a-8eff-4414-8f4e-8fddf9b784d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.260192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0e9c-f0c4-4d15-9797-d0759e61c5d3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.260358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951810a-8eff-4414-8f4e-8fddf9b784d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.262118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951810a-8eff-4414-8f4e-8fddf9b784d6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.271169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 791/1603] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:54.276254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0e9c-f0c4-4d15-9797-d0759e61c5d3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.281189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:54.285163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0e9c-f0c4-4d15-9797-d0759e61c5d3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.289902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e900ae-f1ee-400d-be64-30c1a8a3746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.290911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e900ae-f1ee-400d-be64-30c1a8a3746c admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.291130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e900ae-f1ee-400d-be64-30c1a8a3746c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.291571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e900ae-f1ee-400d-be64-30c1a8a3746c admin admin] PATH_INFO: `/v3/projects/e81b69506d8c4faeb7ae3f537657a673/users/cbb22c3df9e9452db19974f52d3ebb17/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.306950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e900ae-f1ee-400d-be64-30c1a8a3746c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81b69506d8c4faeb7ae3f537657a673, user_id=cbb22c3df9e9452db19974f52d3ebb17, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.309844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e900ae-f1ee-400d-be64-30c1a8a3746c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.400616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 813/1604] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:54 2022] POST /identity/v3/projects => generated 371 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:54.401213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 792/1605] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:54 2022] PUT /identity/v3/projects/e81b69506d8c4faeb7ae3f537657a673/users/cbb22c3df9e9452db19974f52d3ebb17/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:54.402203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3e7f-516f-4e4d-823e-889dadd5146e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.402554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e900ae-f1ee-400d-be64-30c1a8a3746c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.402685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3e7f-516f-4e4d-823e-889dadd5146e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.403052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb3e7f-516f-4e4d-823e-889dadd5146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.431978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-acdb3e7f-516f-4e4d-823e-889dadd5146e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:54.431978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-acdb3e7f-516f-4e4d-823e-889dadd5146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:54.478478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e900ae-f1ee-400d-be64-30c1a8a3746c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.497632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 814/1606] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:54.498748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b9b2e-23be-42aa-989a-5ae45b089f54 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.499068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b9b2e-23be-42aa-989a-5ae45b089f54 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.499376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b9b2e-23be-42aa-989a-5ae45b089f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.527427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f04b9b2e-23be-42aa-989a-5ae45b089f54 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:54.528639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f04b9b2e-23be-42aa-989a-5ae45b089f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:54.536826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 815/1607] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:54.540056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65b5c9-c900-4ffb-b1eb-8bf22760f958 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.540056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65b5c9-c900-4ffb-b1eb-8bf22760f958 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.540056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65b5c9-c900-4ffb-b1eb-8bf22760f958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.544634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fba905-2c97-4dec-a374-c0a5f0a7c021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.545476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fba905-2c97-4dec-a374-c0a5f0a7c021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.545760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fba905-2c97-4dec-a374-c0a5f0a7c021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.546100 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fba905-2c97-4dec-a374-c0a5f0a7c021 admin admin] PATH_INFO: `/v3/projects/06ea8a9bced04406a6f5a65c769c06fe/users/592ae6e403fe4552b181dd700ae14318/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.561220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bd65b5c9-c900-4ffb-b1eb-8bf22760f958 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:54.562475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fba905-2c97-4dec-a374-c0a5f0a7c021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ea8a9bced04406a6f5a65c769c06fe, user_id=592ae6e403fe4552b181dd700ae14318, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.562931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bd65b5c9-c900-4ffb-b1eb-8bf22760f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:54.565451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fba905-2c97-4dec-a374-c0a5f0a7c021 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.570624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 816/1608] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:54.575728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65b5c9-c900-4ffb-b1eb-8bf22760f958 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.584807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65b5c9-c900-4ffb-b1eb-8bf22760f958 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.591310 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363a6ca-8e9b-437e-8a90-6db2f848c77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.592214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a6ca-8e9b-437e-8a90-6db2f848c77e admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.592811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a6ca-8e9b-437e-8a90-6db2f848c77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.593151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363a6ca-8e9b-437e-8a90-6db2f848c77e admin admin] PATH_INFO: `/v3/projects/60cadfa1afa64784b6fc101c913ad40b/users/7193035b7e334898a9d4566a8415ebef/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.611653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363a6ca-8e9b-437e-8a90-6db2f848c77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cadfa1afa64784b6fc101c913ad40b, user_id=7193035b7e334898a9d4566a8415ebef, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.614384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363a6ca-8e9b-437e-8a90-6db2f848c77e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.632369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 793/1609] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:54 2022] PUT /identity/v3/projects/06ea8a9bced04406a6f5a65c769c06fe/users/592ae6e403fe4552b181dd700ae14318/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:54.633306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fba905-2c97-4dec-a374-c0a5f0a7c021 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.685695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 817/1610] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:54 2022] PUT /identity/v3/projects/60cadfa1afa64784b6fc101c913ad40b/users/7193035b7e334898a9d4566a8415ebef/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:54.687206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb005ff7-36c1-473e-9e8b-809a3082edc5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.687566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb005ff7-36c1-473e-9e8b-809a3082edc5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.687915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb005ff7-36c1-473e-9e8b-809a3082edc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.706904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fba905-2c97-4dec-a374-c0a5f0a7c021 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.709332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-eb005ff7-36c1-473e-9e8b-809a3082edc5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:54.710712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eb005ff7-36c1-473e-9e8b-809a3082edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:54.715281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:54.720181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:54.764052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477b40a-e198-4847-987c-33afa6e71e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.764783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477b40a-e198-4847-987c-33afa6e71e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.765072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477b40a-e198-4847-987c-33afa6e71e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.765351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477b40a-e198-4847-987c-33afa6e71e1a admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.766038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477b40a-e198-4847-987c-33afa6e71e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.768056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477b40a-e198-4847-987c-33afa6e71e1a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.770588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 818/1611] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:54.771470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb005ff7-36c1-473e-9e8b-809a3082edc5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.833931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb005ff7-36c1-473e-9e8b-809a3082edc5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.837842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665904bf-a93f-483b-994e-eda98beb5939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.838501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665904bf-a93f-483b-994e-eda98beb5939 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.838787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665904bf-a93f-483b-994e-eda98beb5939 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.839093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665904bf-a93f-483b-994e-eda98beb5939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.856479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665904bf-a93f-483b-994e-eda98beb5939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.856479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665904bf-a93f-483b-994e-eda98beb5939 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.860533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 794/1612] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:54 2022] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:54.861560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477b40a-e198-4847-987c-33afa6e71e1a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.861676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 819/1613] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:45:54.863022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665904bf-a93f-483b-994e-eda98beb5939 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.863712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8477b40a-e198-4847-987c-33afa6e71e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:54.864746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-665904bf-a93f-483b-994e-eda98beb5939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:54.876624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477b40a-e198-4847-987c-33afa6e71e1a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.876900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665904bf-a93f-483b-994e-eda98beb5939 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.880418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4e54b-1ab1-42d3-bc1f-7003d399d39b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.881068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4e54b-1ab1-42d3-bc1f-7003d399d39b service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.885276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02393433-de47-4159-ad26-398deeeca16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.885468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4e54b-1ab1-42d3-bc1f-7003d399d39b service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.885468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4e54b-1ab1-42d3-bc1f-7003d399d39b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.885817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02393433-de47-4159-ad26-398deeeca16d service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.885817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02393433-de47-4159-ad26-398deeeca16d service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.885817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02393433-de47-4159-ad26-398deeeca16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.892228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02393433-de47-4159-ad26-398deeeca16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.892613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4e54b-1ab1-42d3-bc1f-7003d399d39b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.893663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02393433-de47-4159-ad26-398deeeca16d service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.894064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4e54b-1ab1-42d3-bc1f-7003d399d39b service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.903698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 820/1614] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:45:54.904096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 795/1615] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:45:54.904850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01908fea-a63a-45f2-af4d-0aebd84761f7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.905147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01908fea-a63a-45f2-af4d-0aebd84761f7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.905313 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cf712-7c46-4ee7-ac64-9df634bb17ba None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.905448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01908fea-a63a-45f2-af4d-0aebd84761f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.905608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cf712-7c46-4ee7-ac64-9df634bb17ba None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.905897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cf712-7c46-4ee7-ac64-9df634bb17ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.924336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-662cf712-7c46-4ee7-ac64-9df634bb17ba None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:54.925677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-662cf712-7c46-4ee7-ac64-9df634bb17ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:54.940559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 796/1616] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:54.944899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cf712-7c46-4ee7-ac64-9df634bb17ba None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:54.948941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-01908fea-a63a-45f2-af4d-0aebd84761f7 None None] MFA Rules not processed for user `592ae6e403fe4552b181dd700ae14318`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:54.950184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-01908fea-a63a-45f2-af4d-0aebd84761f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:54.952499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cf712-7c46-4ee7-ac64-9df634bb17ba None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:54.957178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b188c0-eef3-452e-b8a6-1cf984f44c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:54.957833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b188c0-eef3-452e-b8a6-1cf984f44c4c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:54.958134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b188c0-eef3-452e-b8a6-1cf984f44c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:54.958381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b188c0-eef3-452e-b8a6-1cf984f44c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:54.974977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b188c0-eef3-452e-b8a6-1cf984f44c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:54.976832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b188c0-eef3-452e-b8a6-1cf984f44c4c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:54.989521 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 797/1617] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:45:54.990448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b188c0-eef3-452e-b8a6-1cf984f44c4c service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:55.006293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b188c0-eef3-452e-b8a6-1cf984f44c4c service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:55.018066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac487c-a45d-4dd3-b9a3-ae908b9181e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:55.018756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac487c-a45d-4dd3-b9a3-ae908b9181e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:55.019141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac487c-a45d-4dd3-b9a3-ae908b9181e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:55.019428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac487c-a45d-4dd3-b9a3-ae908b9181e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:55.020163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac487c-a45d-4dd3-b9a3-ae908b9181e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:55.021775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac487c-a45d-4dd3-b9a3-ae908b9181e4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:55.039108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 821/1618] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:55.040136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01908fea-a63a-45f2-af4d-0aebd84761f7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:55.040394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 798/1619] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:55.042631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac487c-a45d-4dd3-b9a3-ae908b9181e4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:55.054112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac487c-a45d-4dd3-b9a3-ae908b9181e4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:55.064206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01908fea-a63a-45f2-af4d-0aebd84761f7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:55.064325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c134448-45a9-48f6-a5eb-d31f862a81f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:55.064325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c134448-45a9-48f6-a5eb-d31f862a81f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:55.064325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c134448-45a9-48f6-a5eb-d31f862a81f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:55.064325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c134448-45a9-48f6-a5eb-d31f862a81f3 admin admin] PATH_INFO: `/v3/projects/6a485b6e64ac4a99808e0716d2cce66a/users/d4519b28f62d46ffa50bec94fdfdf3f9/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:55.065258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dc89e-a0b3-43ea-94ec-b7bd9e5ef200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:55.065951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dc89e-a0b3-43ea-94ec-b7bd9e5ef200 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:55.066242 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dc89e-a0b3-43ea-94ec-b7bd9e5ef200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:55.066523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dc89e-a0b3-43ea-94ec-b7bd9e5ef200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:55.077603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dc89e-a0b3-43ea-94ec-b7bd9e5ef200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:55.079124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dc89e-a0b3-43ea-94ec-b7bd9e5ef200 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:55.081263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c134448-45a9-48f6-a5eb-d31f862a81f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a485b6e64ac4a99808e0716d2cce66a, user_id=d4519b28f62d46ffa50bec94fdfdf3f9, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:55.085005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c134448-45a9-48f6-a5eb-d31f862a81f3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:55.091629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 822/1620] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:45:55.092390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dc89e-a0b3-43ea-94ec-b7bd9e5ef200 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:55.112883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:55.163447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dc89e-a0b3-43ea-94ec-b7bd9e5ef200 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:55.169401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97fd5-4089-486a-b96f-62cf728ca175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:55.170070 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97fd5-4089-486a-b96f-62cf728ca175 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:55.170356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97fd5-4089-486a-b96f-62cf728ca175 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:55.170635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c97fd5-4089-486a-b96f-62cf728ca175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:55.180419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 799/1621] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:55 2022] PUT /identity/v3/projects/6a485b6e64ac4a99808e0716d2cce66a/users/d4519b28f62d46ffa50bec94fdfdf3f9/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:55.184957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c134448-45a9-48f6-a5eb-d31f862a81f3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:55.185496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c97fd5-4089-486a-b96f-62cf728ca175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:55.188073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c97fd5-4089-486a-b96f-62cf728ca175 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:55.210556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 823/1622] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:45:55.316339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c134448-45a9-48f6-a5eb-d31f862a81f3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:55.327231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb9ed8-efee-42df-937a-debf4425c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:55.330813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb9ed8-efee-42df-937a-debf4425c9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:55.330813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb9ed8-efee-42df-937a-debf4425c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:55.330813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb9ed8-efee-42df-937a-debf4425c9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:55.330813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb9ed8-efee-42df-937a-debf4425c9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:55.331178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb9ed8-efee-42df-937a-debf4425c9e5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:55.360797 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 800/1623] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:45:55.364625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97fd5-4089-486a-b96f-62cf728ca175 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:55.379213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c97fd5-4089-486a-b96f-62cf728ca175 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:55.402342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03175b89-3501-497a-9ae8-4e093eb7355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:55.403211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03175b89-3501-497a-9ae8-4e093eb7355c admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:55.403508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03175b89-3501-497a-9ae8-4e093eb7355c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:55.403788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03175b89-3501-497a-9ae8-4e093eb7355c admin admin] PATH_INFO: `/v3/projects/6a485b6e64ac4a99808e0716d2cce66a/users/d4519b28f62d46ffa50bec94fdfdf3f9/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:55.410761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03175b89-3501-497a-9ae8-4e093eb7355c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a485b6e64ac4a99808e0716d2cce66a, user_id=d4519b28f62d46ffa50bec94fdfdf3f9, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:55.413495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03175b89-3501-497a-9ae8-4e093eb7355c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:55.427513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 824/1624] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:55 2022] PUT /identity/v3/projects/6a485b6e64ac4a99808e0716d2cce66a/users/d4519b28f62d46ffa50bec94fdfdf3f9/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:55.439206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae029e2-e22b-4cb2-aee9-862b2fa1dfc8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:55.439491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae029e2-e22b-4cb2-aee9-862b2fa1dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:55.440483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae029e2-e22b-4cb2-aee9-862b2fa1dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:55.476720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6ae029e2-e22b-4cb2-aee9-862b2fa1dfc8 None None] MFA Rules not processed for user `d4519b28f62d46ffa50bec94fdfdf3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:55.478479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6ae029e2-e22b-4cb2-aee9-862b2fa1dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:55.512448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:55.584907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 801/1625] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:55.602826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03175b89-3501-497a-9ae8-4e093eb7355c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:55.695954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03175b89-3501-497a-9ae8-4e093eb7355c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:55.700917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24155195-4902-4c79-85f1-1010b3e0d648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:55.701600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24155195-4902-4c79-85f1-1010b3e0d648 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:55.701871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24155195-4902-4c79-85f1-1010b3e0d648 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:55.702756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24155195-4902-4c79-85f1-1010b3e0d648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:55.717093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24155195-4902-4c79-85f1-1010b3e0d648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:55.720314 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24155195-4902-4c79-85f1-1010b3e0d648 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:55.745409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 825/1626] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:45:57.172269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae029e2-e22b-4cb2-aee9-862b2fa1dfc8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:57.237237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c2f02-6f6e-44a8-8a2f-c412a27b2cfc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:57.237852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c2f02-6f6e-44a8-8a2f-c412a27b2cfc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:57.237852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c2f02-6f6e-44a8-8a2f-c412a27b2cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:57.303958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e02c2f02-6f6e-44a8-8a2f-c412a27b2cfc None None] MFA Rules not processed for user `2e90e00230bf4a49bf80366bab518798`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:57.306677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e02c2f02-6f6e-44a8-8a2f-c412a27b2cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:57.320713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae029e2-e22b-4cb2-aee9-862b2fa1dfc8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:57.331064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:57.332029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:57.332312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:57.332579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] PATH_INFO: `/v3/users/14a3d01823994fe09597417e6481246b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:57.335625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a3d01823994fe09597417e6481246b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:57.338148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:57.436928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 826/1627] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:57.441540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c2f02-6f6e-44a8-8a2f-c412a27b2cfc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:57.460528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c2f02-6f6e-44a8-8a2f-c412a27b2cfc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:57.461239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72958aa8-38c4-41dd-a997-b2fb057b086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:57.461982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72958aa8-38c4-41dd-a997-b2fb057b086d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:57.462524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72958aa8-38c4-41dd-a997-b2fb057b086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:57.462985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72958aa8-38c4-41dd-a997-b2fb057b086d admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:57.463776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72958aa8-38c4-41dd-a997-b2fb057b086d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:57.466124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72958aa8-38c4-41dd-a997-b2fb057b086d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:57.615551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 827/1628] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:45:57 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:57.633601 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72958aa8-38c4-41dd-a997-b2fb057b086d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:57.678201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a3d01823994fe09597417e6481246b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:45:57.680915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a3d01823994fe09597417e6481246b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:45:57.730688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a3d01823994fe09597417e6481246b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:45:57.735857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:57.779611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a3d01823994fe09597417e6481246b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:45:57.845947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72958aa8-38c4-41dd-a997-b2fb057b086d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:57.867510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1880e1e7-ad77-49b7-a103-da46ca42c930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a3d01823994fe09597417e6481246b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:45:57.868849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd41997-df1e-4ac3-8239-8ba1bb2053be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:57.871203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd41997-df1e-4ac3-8239-8ba1bb2053be admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:57.874935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd41997-df1e-4ac3-8239-8ba1bb2053be admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:57.874935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd41997-df1e-4ac3-8239-8ba1bb2053be admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:57.874935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd41997-df1e-4ac3-8239-8ba1bb2053be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:57.876047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 802/1629] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:45:57 2022] DELETE /identity/v3/users/14a3d01823994fe09597417e6481246b => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:57.881065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01203d81-f2c1-48a3-bc45-295c7b17be31 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:57.881353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01203d81-f2c1-48a3-bc45-295c7b17be31 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:57.881730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01203d81-f2c1-48a3-bc45-295c7b17be31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:57.890071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd41997-df1e-4ac3-8239-8ba1bb2053be admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:57.919574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-01203d81-f2c1-48a3-bc45-295c7b17be31 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:57.923803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-01203d81-f2c1-48a3-bc45-295c7b17be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:57.973677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:58.032826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 828/1630] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:45:57 2022] POST /identity/v3/users => generated 309 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:45:58.035003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd41997-df1e-4ac3-8239-8ba1bb2053be admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:58.035972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 803/1631] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:45:58.037694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01203d81-f2c1-48a3-bc45-295c7b17be31 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:58.039342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ccd41997-df1e-4ac3-8239-8ba1bb2053be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:58.040399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-01203d81-f2c1-48a3-bc45-295c7b17be31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:58.070423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01203d81-f2c1-48a3-bc45-295c7b17be31 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:58.091764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbbc80-401c-4bba-9681-d50e9ba79855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:58.092800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbbc80-401c-4bba-9681-d50e9ba79855 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:58.093267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbbc80-401c-4bba-9681-d50e9ba79855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:58.093707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbbc80-401c-4bba-9681-d50e9ba79855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:58.094938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbbc80-401c-4bba-9681-d50e9ba79855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:58.096775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbbc80-401c-4bba-9681-d50e9ba79855 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:58.126256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 804/1632] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:58.128099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbbc80-401c-4bba-9681-d50e9ba79855 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:58.150998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbbc80-401c-4bba-9681-d50e9ba79855 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:58.158184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd41997-df1e-4ac3-8239-8ba1bb2053be admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:58.165665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bc6d1-27ab-40f6-b375-2f65d15ba4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:58.165665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bc6d1-27ab-40f6-b375-2f65d15ba4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:58.165665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bc6d1-27ab-40f6-b375-2f65d15ba4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:58.165665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bc6d1-27ab-40f6-b375-2f65d15ba4f5 admin admin] PATH_INFO: `/v3/projects/1dbfd781353a4bba96f8a3b3974a95fe/users/c4dbebacd98349ffb2f6d2f3ee78548d/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:58.185755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bc6d1-27ab-40f6-b375-2f65d15ba4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbfd781353a4bba96f8a3b3974a95fe, user_id=c4dbebacd98349ffb2f6d2f3ee78548d, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:58.189352 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bc6d1-27ab-40f6-b375-2f65d15ba4f5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:58.258375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4ba2-abe7-4a11-8bad-c51f0edc8509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:58.534125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4ba2-abe7-4a11-8bad-c51f0edc8509 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:58.534125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4ba2-abe7-4a11-8bad-c51f0edc8509 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:58.534125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4ba2-abe7-4a11-8bad-c51f0edc8509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:58.535932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 805/1633] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:58 2022] PUT /identity/v3/projects/1dbfd781353a4bba96f8a3b3974a95fe/users/c4dbebacd98349ffb2f6d2f3ee78548d/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:58.535932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bc6d1-27ab-40f6-b375-2f65d15ba4f5 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:58.537229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b4ba2-abe7-4a11-8bad-c51f0edc8509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:58.537229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b4ba2-abe7-4a11-8bad-c51f0edc8509 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:58.537229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 829/1634] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:45:58.538614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bc6d1-27ab-40f6-b375-2f65d15ba4f5 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:58.538614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df91c2b-c205-468c-8d5b-b23c41c35ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:58.538614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91c2b-c205-468c-8d5b-b23c41c35ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:58.538614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91c2b-c205-468c-8d5b-b23c41c35ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:58.539579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91c2b-c205-468c-8d5b-b23c41c35ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:58.539579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df91c2b-c205-468c-8d5b-b23c41c35ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:58.539579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df91c2b-c205-468c-8d5b-b23c41c35ae8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:58.539579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 806/1635] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:45:58.541430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4ba2-abe7-4a11-8bad-c51f0edc8509 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:58.541430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4ba2-abe7-4a11-8bad-c51f0edc8509 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:58.541430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d7983-953f-42f6-b505-516bcf420657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:58.541430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d7983-953f-42f6-b505-516bcf420657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:58.542402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d7983-953f-42f6-b505-516bcf420657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:58.542402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d7983-953f-42f6-b505-516bcf420657 admin admin] PATH_INFO: `/v3/projects/1dbfd781353a4bba96f8a3b3974a95fe/users/c4dbebacd98349ffb2f6d2f3ee78548d/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:58.542402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d7983-953f-42f6-b505-516bcf420657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbfd781353a4bba96f8a3b3974a95fe, user_id=c4dbebacd98349ffb2f6d2f3ee78548d, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:58.542402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d7983-953f-42f6-b505-516bcf420657 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:58.542402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 830/1636] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:45:58 2022] PUT /identity/v3/projects/1dbfd781353a4bba96f8a3b3974a95fe/users/c4dbebacd98349ffb2f6d2f3ee78548d/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:45:59.334232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aae72b-ea57-40b0-9a1a-85da958dba29 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:59.335214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aae72b-ea57-40b0-9a1a-85da958dba29 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:59.335802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aae72b-ea57-40b0-9a1a-85da958dba29 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:59.339229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 807/1637] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 09:45:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:45:59.347063 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4a0e4-3609-4137-a36f-401abcaea31b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:59.347575 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4a0e4-3609-4137-a36f-401abcaea31b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:59.347641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb4a0e4-3609-4137-a36f-401abcaea31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:59.391900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4eb4a0e4-3609-4137-a36f-401abcaea31b None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:59.393642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4eb4a0e4-3609-4137-a36f-401abcaea31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:59.489036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:45:59.520932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 831/1638] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 09:45:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:59.528799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f941b6-e6dd-4b4f-8d65-68beea19c1a0 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:59.529216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f941b6-e6dd-4b4f-8d65-68beea19c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:59.530123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f941b6-e6dd-4b4f-8d65-68beea19c1a0 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:59.532122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 808/1639] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 09:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:45:59.538985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bfbbf-efd5-48ee-9111-cdf85778ae0f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:59.544546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bfbbf-efd5-48ee-9111-cdf85778ae0f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:59.544546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218bfbbf-efd5-48ee-9111-cdf85778ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:59.593323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-218bfbbf-efd5-48ee-9111-cdf85778ae0f None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:45:59.601290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-218bfbbf-efd5-48ee-9111-cdf85778ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:59.627534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 832/1640] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:45:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:45:59.636980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f941b6-e6dd-4b4f-8d65-68beea19c1a0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:45:59.639967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-29f941b6-e6dd-4b4f-8d65-68beea19c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:45:59.754757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f941b6-e6dd-4b4f-8d65-68beea19c1a0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:45:59.761756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c70f6-c84d-4461-a681-711137cd368f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:45:59.762697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c70f6-c84d-4461-a681-711137cd368f service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:45:59.763282 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c70f6-c84d-4461-a681-711137cd368f service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:45:59.773345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c70f6-c84d-4461-a681-711137cd368f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:45:59.812290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c70f6-c84d-4461-a681-711137cd368f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:45:59.814135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c70f6-c84d-4461-a681-711137cd368f service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:45:59.864965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 809/1641] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:45:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:00.511943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bfbbf-efd5-48ee-9111-cdf85778ae0f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:00.513387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-218bfbbf-efd5-48ee-9111-cdf85778ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:00.663145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218bfbbf-efd5-48ee-9111-cdf85778ae0f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:00.678991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:00.679961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:00.680961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:00.680961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] PATH_INFO: `/v3/projects/da3a79914e604cff98a807078e5ac5bc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:00.683639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3a79914e604cff98a807078e5ac5bc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:00.685772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:00.852536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3a79914e604cff98a807078e5ac5bc', 'request_id': 'req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:00.992478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3a79914e604cff98a807078e5ac5bc', 'request_id': 'req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:01.007555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3a79914e604cff98a807078e5ac5bc', 'request_id': 'req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:01.048170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] The token cache is being invalidate because project da3a79914e604cff98a807078e5ac5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:01.048671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:01.049827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a52b2502-b187-4c3b-b7a3-c3ccb7f83ed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:01.052578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 833/1642] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:00 2022] DELETE /identity/v3/projects/da3a79914e604cff98a807078e5ac5bc => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:01.057006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c70f6-c84d-4461-a681-711137cd368f service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:01.076068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c70f6-c84d-4461-a681-711137cd368f service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:01.253328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:01.277266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:01.278315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:01.278800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:01.279297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] PATH_INFO: `/v3/users/d4519b28f62d46ffa50bec94fdfdf3f9` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:01.280647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4519b28f62d46ffa50bec94fdfdf3f9)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:01.282757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:01.541710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4519b28f62d46ffa50bec94fdfdf3f9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:01.542745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4519b28f62d46ffa50bec94fdfdf3f9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:01.567209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4519b28f62d46ffa50bec94fdfdf3f9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:01.605666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4519b28f62d46ffa50bec94fdfdf3f9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:01.684555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-536ce769-ebf6-4909-9cf8-ebfa70117e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4519b28f62d46ffa50bec94fdfdf3f9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:01.706122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 810/1643] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:01 2022] DELETE /identity/v3/users/d4519b28f62d46ffa50bec94fdfdf3f9 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:01.853039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f58c3-476c-4e17-bb33-5f111239776c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:01.860127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f58c3-476c-4e17-bb33-5f111239776c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:01.860127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f58c3-476c-4e17-bb33-5f111239776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:01.943206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0a4f58c3-476c-4e17-bb33-5f111239776c None None] MFA Rules not processed for user `c4dbebacd98349ffb2f6d2f3ee78548d`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:01.949744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0a4f58c3-476c-4e17-bb33-5f111239776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:02.116380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:02.155772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 834/1644] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:02.717205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbaffd-0969-4732-9900-dea232dd2667 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:02.717955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbaffd-0969-4732-9900-dea232dd2667 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:02.717955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbaffd-0969-4732-9900-dea232dd2667 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:02.719583 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 811/1645] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 09:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:46:02.738247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd0de-ef6c-4bcb-80c9-78e047114fc2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:02.739203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd0de-ef6c-4bcb-80c9-78e047114fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:02.739777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd0de-ef6c-4bcb-80c9-78e047114fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:02.831995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2a4dd0de-ef6c-4bcb-80c9-78e047114fc2 None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:02.833745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2a4dd0de-ef6c-4bcb-80c9-78e047114fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:03.089820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 835/1646] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 09:46:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:03.100005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce331422-06e4-4cb7-a545-8ebbccb5b3ea None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:03.100306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce331422-06e4-4cb7-a545-8ebbccb5b3ea None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:03.100586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce331422-06e4-4cb7-a545-8ebbccb5b3ea None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:03.102462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 812/1647] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 09:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:46:03.116174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea4ed-9cef-49e7-8404-1f34b9e9484a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:03.116476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea4ed-9cef-49e7-8404-1f34b9e9484a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:03.116765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ea4ed-9cef-49e7-8404-1f34b9e9484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:03.156315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9b6ea4ed-9cef-49e7-8404-1f34b9e9484a None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:03.158111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9b6ea4ed-9cef-49e7-8404-1f34b9e9484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:03.191485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 836/1648] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:46:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:03.210307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce331422-06e4-4cb7-a545-8ebbccb5b3ea None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:03.214458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ce331422-06e4-4cb7-a545-8ebbccb5b3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:03.331408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce331422-06e4-4cb7-a545-8ebbccb5b3ea None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:03.352462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44a211-59a5-453f-9ea4-67e4b4041f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:03.353561 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a211-59a5-453f-9ea4-67e4b4041f3c service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:03.354155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a211-59a5-453f-9ea4-67e4b4041f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:03.354589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44a211-59a5-453f-9ea4-67e4b4041f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:03.367206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44a211-59a5-453f-9ea4-67e4b4041f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:03.370351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44a211-59a5-453f-9ea4-67e4b4041f3c service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:03.396399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 813/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:04.742399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea4ed-9cef-49e7-8404-1f34b9e9484a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:04.744851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9b6ea4ed-9cef-49e7-8404-1f34b9e9484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:04.870982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ea4ed-9cef-49e7-8404-1f34b9e9484a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:04.876287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:04.877244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:04.877600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:04.877950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] PATH_INFO: `/v3/projects/6a485b6e64ac4a99808e0716d2cce66a` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:04.879259 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a485b6e64ac4a99808e0716d2cce66a)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:04.881264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:05.026405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a485b6e64ac4a99808e0716d2cce66a', 'request_id': 'req-19eaaae0-4195-43ae-bf45-fd8d82be0b94'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:05.148794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a485b6e64ac4a99808e0716d2cce66a', 'request_id': 'req-19eaaae0-4195-43ae-bf45-fd8d82be0b94'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:05.160399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a485b6e64ac4a99808e0716d2cce66a', 'request_id': 'req-19eaaae0-4195-43ae-bf45-fd8d82be0b94'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:05.184119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] The token cache is being invalidate because project 6a485b6e64ac4a99808e0716d2cce66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:05.186959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:05.186959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-19eaaae0-4195-43ae-bf45-fd8d82be0b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:05.187672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 837/1650] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:04 2022] DELETE /identity/v3/projects/6a485b6e64ac4a99808e0716d2cce66a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:05.192745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc63c-3cd8-4fbf-a74c-2f44957c8844 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:05.193670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc63c-3cd8-4fbf-a74c-2f44957c8844 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:05.194794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416bc63c-3cd8-4fbf-a74c-2f44957c8844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:05.218336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-416bc63c-3cd8-4fbf-a74c-2f44957c8844 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:05.219874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-416bc63c-3cd8-4fbf-a74c-2f44957c8844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:05.309807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 814/1651] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:05.317986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd568a1-71ea-459c-b3e8-6005c3aaa501 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:05.318320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd568a1-71ea-459c-b3e8-6005c3aaa501 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:05.318893 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd568a1-71ea-459c-b3e8-6005c3aaa501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:05.355307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29828bfb-5789-4461-855c-d486f65c818c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:05.356275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29828bfb-5789-4461-855c-d486f65c818c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:05.356275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29828bfb-5789-4461-855c-d486f65c818c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:05.357990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:05.362168 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 815/1652] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:46:05 2022] GET /identity => generated 270 bytes in 24 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:46:05.367517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4bd568a1-71ea-459c-b3e8-6005c3aaa501 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:05.369737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4bd568a1-71ea-459c-b3e8-6005c3aaa501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:05.382781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 838/1653] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:05.385843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29828bfb-5789-4461-855c-d486f65c818c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:05.411873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af9f93-7232-4b33-8ac6-6908c60c5465 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:05.412167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af9f93-7232-4b33-8ac6-6908c60c5465 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:05.417048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af9f93-7232-4b33-8ac6-6908c60c5465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:05.424903 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29828bfb-5789-4461-855c-d486f65c818c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:05.438047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6b96-59a2-4386-aefd-37fbb8807c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:05.443472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6b96-59a2-4386-aefd-37fbb8807c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:05.443472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6b96-59a2-4386-aefd-37fbb8807c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:05.443472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e6b96-59a2-4386-aefd-37fbb8807c07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:05.443472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e6b96-59a2-4386-aefd-37fbb8807c07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:46:05.444198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e6b96-59a2-4386-aefd-37fbb8807c07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:05.449788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9e6b96-59a2-4386-aefd-37fbb8807c07 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:05.453283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:05.467365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-55af9f93-7232-4b33-8ac6-6908c60c5465 None None] MFA Rules not processed for user `87fd5580ed264a08a3ad31850e0a53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:05.470398 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-55af9f93-7232-4b33-8ac6-6908c60c5465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:05.481565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 816/1654] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:46:05.483346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6b96-59a2-4386-aefd-37fbb8807c07 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:05.509063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e6b96-59a2-4386-aefd-37fbb8807c07 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:05.534981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2b252-8ad3-4961-9f93-8b83348d8d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:05.537824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b252-8ad3-4961-9f93-8b83348d8d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:05.538982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b252-8ad3-4961-9f93-8b83348d8d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:05.539343 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2b252-8ad3-4961-9f93-8b83348d8d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:05.543582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2b252-8ad3-4961-9f93-8b83348d8d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:05.553125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2b252-8ad3-4961-9f93-8b83348d8d22 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:05.705362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 839/1655] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:46:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:05.744682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 817/1656] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:05 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:05.747021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af9f93-7232-4b33-8ac6-6908c60c5465 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:05.762998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af9f93-7232-4b33-8ac6-6908c60c5465 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:05.809111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bddd18-6df2-4f71-a897-0a1cf63223e7 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:05.809543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bddd18-6df2-4f71-a897-0a1cf63223e7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:05.809929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bddd18-6df2-4f71-a897-0a1cf63223e7 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:05.812012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 818/1657] 10.222.0.42 () {54 vars in 960 bytes} [Fri Jun 24 09:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:46:05.823867 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094dc33-ca70-45a9-bd75-b8a13b317286 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:05.824500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094dc33-ca70-45a9-bd75-b8a13b317286 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:05.825060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094dc33-ca70-45a9-bd75-b8a13b317286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:05.888383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7094dc33-ca70-45a9-bd75-b8a13b317286 None None] MFA Rules not processed for user `87fd5580ed264a08a3ad31850e0a53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:05.894790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7094dc33-ca70-45a9-bd75-b8a13b317286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:06.008703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7460d4e-12f6-44e3-b38c-b1e7124e7f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:06.012100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460d4e-12f6-44e3-b38c-b1e7124e7f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:06.014600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460d4e-12f6-44e3-b38c-b1e7124e7f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:06.015655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7460d4e-12f6-44e3-b38c-b1e7124e7f05 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:06.016523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7460d4e-12f6-44e3-b38c-b1e7124e7f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:06.028728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7460d4e-12f6-44e3-b38c-b1e7124e7f05 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:06.125173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 819/1658] 10.222.0.42 () {58 vars in 1057 bytes} [Fri Jun 24 09:46:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 24 09:46:06.126815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094dc33-ca70-45a9-bd75-b8a13b317286 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:06.140737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094dc33-ca70-45a9-bd75-b8a13b317286 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:06.148912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6009-860c-45b6-94aa-337a8046c1f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:06.149713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6009-860c-45b6-94aa-337a8046c1f4 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:06.157847 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6009-860c-45b6-94aa-337a8046c1f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:06.157847 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc6009-860c-45b6-94aa-337a8046c1f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:06.165531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6009-860c-45b6-94aa-337a8046c1f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:06.173278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dc6009-860c-45b6-94aa-337a8046c1f4 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:06.204928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 820/1659] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:06.235163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 840/1660] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:05 2022] POST /identity/v3/users => generated 292 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:06.236284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6009-860c-45b6-94aa-337a8046c1f4 service placement] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:06.278885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b3db-6bc3-4066-baa6-4c3ad3afe244 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:06.279272 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b3db-6bc3-4066-baa6-4c3ad3afe244 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:06.280263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63b3db-6bc3-4066-baa6-4c3ad3afe244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:06.297247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc6009-860c-45b6-94aa-337a8046c1f4 service placement] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:06.310187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00454c7-8dd0-4e9a-9d26-ff915658a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:06.315276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00454c7-8dd0-4e9a-9d26-ff915658a89b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:06.316484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00454c7-8dd0-4e9a-9d26-ff915658a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:06.317123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00454c7-8dd0-4e9a-9d26-ff915658a89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:06.319231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00454c7-8dd0-4e9a-9d26-ff915658a89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:06.324290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00454c7-8dd0-4e9a-9d26-ff915658a89b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:06.340777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7b63b3db-6bc3-4066-baa6-4c3ad3afe244 None None] MFA Rules not processed for user `2cdef290abf8487ab370969a5e5b76c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:06.341887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7b63b3db-6bc3-4066-baa6-4c3ad3afe244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:06.352018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 821/1661] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:06.354126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00454c7-8dd0-4e9a-9d26-ff915658a89b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:06.377041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00454c7-8dd0-4e9a-9d26-ff915658a89b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:06.399295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d369-1bf3-4d22-852d-b92e0c5b491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:06.399295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d369-1bf3-4d22-852d-b92e0c5b491f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:06.399295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d369-1bf3-4d22-852d-b92e0c5b491f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:06.399295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80d369-1bf3-4d22-852d-b92e0c5b491f admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:06.399821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d369-1bf3-4d22-852d-b92e0c5b491f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:06.405618 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80d369-1bf3-4d22-852d-b92e0c5b491f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:06.437569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 822/1662] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:06.454562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d369-1bf3-4d22-852d-b92e0c5b491f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:06.472806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80d369-1bf3-4d22-852d-b92e0c5b491f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:06.479748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc7acd-0cda-443b-b28f-a2a05c7ccb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:06.480796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7acd-0cda-443b-b28f-a2a05c7ccb60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:06.481190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7acd-0cda-443b-b28f-a2a05c7ccb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:06.482005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc7acd-0cda-443b-b28f-a2a05c7ccb60 admin admin] PATH_INFO: `/v3/projects/ebfc24b324224839af84ca4175024caf/users/89e75885365643fbb38fba27fe4355ce/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:06.502990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc7acd-0cda-443b-b28f-a2a05c7ccb60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfc24b324224839af84ca4175024caf, user_id=89e75885365643fbb38fba27fe4355ce, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:06.506173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc7acd-0cda-443b-b28f-a2a05c7ccb60 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:06.570974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 841/1663] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:06.574766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111514e-9904-4dee-a7e6-e14e19538150 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:06.575177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111514e-9904-4dee-a7e6-e14e19538150 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:06.575449 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111514e-9904-4dee-a7e6-e14e19538150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:06.604218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 823/1664] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:06 2022] PUT /identity/v3/projects/ebfc24b324224839af84ca4175024caf/users/89e75885365643fbb38fba27fe4355ce/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:06.616918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5eb56-c71e-41ed-b5b0-52ca5126c3fb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:06.617654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5eb56-c71e-41ed-b5b0-52ca5126c3fb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:06.618165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5eb56-c71e-41ed-b5b0-52ca5126c3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:06.619807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9111514e-9904-4dee-a7e6-e14e19538150 None None] MFA Rules not processed for user `2cdef290abf8487ab370969a5e5b76c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:06.620455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9111514e-9904-4dee-a7e6-e14e19538150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:06.687862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 842/1665] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:06.710481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111514e-9904-4dee-a7e6-e14e19538150 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:06.712188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8bb5eb56-c71e-41ed-b5b0-52ca5126c3fb None None] MFA Rules not processed for user `89e75885365643fbb38fba27fe4355ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:06.715495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9111514e-9904-4dee-a7e6-e14e19538150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:06.716691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8bb5eb56-c71e-41ed-b5b0-52ca5126c3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:06.816690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111514e-9904-4dee-a7e6-e14e19538150 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:06.833343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59272e-93c3-430f-953d-fff2e8657142 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:06.834351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59272e-93c3-430f-953d-fff2e8657142 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:06.834798 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59272e-93c3-430f-953d-fff2e8657142 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:06.835254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59272e-93c3-430f-953d-fff2e8657142 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:06.849758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59272e-93c3-430f-953d-fff2e8657142 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:06.855416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59272e-93c3-430f-953d-fff2e8657142 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:06.883319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 843/1666] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:06.911641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 824/1667] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:06.912924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59272e-93c3-430f-953d-fff2e8657142 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:07.015663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:07.102047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59272e-93c3-430f-953d-fff2e8657142 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:07.108336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8f32-0d76-4beb-b7ff-11f136fc5db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:07.108336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8f32-0d76-4beb-b7ff-11f136fc5db0 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:07.108612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8f32-0d76-4beb-b7ff-11f136fc5db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:07.108997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8f32-0d76-4beb-b7ff-11f136fc5db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:07.109808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b8f32-0d76-4beb-b7ff-11f136fc5db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:07.112582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b8f32-0d76-4beb-b7ff-11f136fc5db0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:07.239329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:07.248833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 844/1668] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:06 2022] POST /identity/v3/projects => generated 387 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:07.252796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5eb56-c71e-41ed-b5b0-52ca5126c3fb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:07.269652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5eb56-c71e-41ed-b5b0-52ca5126c3fb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:07.393951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917c44-7151-4199-b115-6b1b8163e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:07.395985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917c44-7151-4199-b115-6b1b8163e7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:07.395985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917c44-7151-4199-b115-6b1b8163e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:07.395985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa917c44-7151-4199-b115-6b1b8163e7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:07.395985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa917c44-7151-4199-b115-6b1b8163e7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:07.398231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa917c44-7151-4199-b115-6b1b8163e7f4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:07.517915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 825/1669] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:07 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:46:07.524691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8f32-0d76-4beb-b7ff-11f136fc5db0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:07.552543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8f32-0d76-4beb-b7ff-11f136fc5db0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:07.563457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56d9ec-5c89-45cb-9fd0-c5f0145ba1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:07.564369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56d9ec-5c89-45cb-9fd0-c5f0145ba1da admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:07.567914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56d9ec-5c89-45cb-9fd0-c5f0145ba1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:07.567914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56d9ec-5c89-45cb-9fd0-c5f0145ba1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:07.567914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56d9ec-5c89-45cb-9fd0-c5f0145ba1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:07.567914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56d9ec-5c89-45cb-9fd0-c5f0145ba1da admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:07.602767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 845/1670] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:07.602869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917c44-7151-4199-b115-6b1b8163e7f4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:07.631617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa917c44-7151-4199-b115-6b1b8163e7f4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:07.649084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cb4f7-8a63-4c7e-8fc8-29e2e7a27e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:07.649780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cb4f7-8a63-4c7e-8fc8-29e2e7a27e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:07.650137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cb4f7-8a63-4c7e-8fc8-29e2e7a27e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:07.651047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cb4f7-8a63-4c7e-8fc8-29e2e7a27e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:07.651800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cb4f7-8a63-4c7e-8fc8-29e2e7a27e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:07.653429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cb4f7-8a63-4c7e-8fc8-29e2e7a27e3e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:07.673188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 826/1671] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:07.677033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56d9ec-5c89-45cb-9fd0-c5f0145ba1da admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:07.700548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56d9ec-5c89-45cb-9fd0-c5f0145ba1da admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:07.713860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515df35-25fd-4243-a8b2-6193f0061d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:07.715329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515df35-25fd-4243-a8b2-6193f0061d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:07.715632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515df35-25fd-4243-a8b2-6193f0061d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:07.715917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515df35-25fd-4243-a8b2-6193f0061d11 admin admin] PATH_INFO: `/v3/projects/b375ee63f20c4b32a30c97ed8b366a3d/users/9a2afd9d1074460a9637f0ce67385a83/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:07.749548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515df35-25fd-4243-a8b2-6193f0061d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b375ee63f20c4b32a30c97ed8b366a3d, user_id=9a2afd9d1074460a9637f0ce67385a83, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:07.758460 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515df35-25fd-4243-a8b2-6193f0061d11 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:07.767882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0a966-03ad-45af-85b9-abec581f83af None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:07.768179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0a966-03ad-45af-85b9-abec581f83af None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:07.768466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0a966-03ad-45af-85b9-abec581f83af None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:07.769841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 827/1672] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 09:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:46:07.784497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381249-fad0-4fed-9952-93889b2d6748 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:07.784988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381249-fad0-4fed-9952-93889b2d6748 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:07.785272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381249-fad0-4fed-9952-93889b2d6748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:07.883973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 846/1673] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:07 2022] PUT /identity/v3/projects/b375ee63f20c4b32a30c97ed8b366a3d/users/9a2afd9d1074460a9637f0ce67385a83/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:07.887288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ea9cf-6990-4c76-bc51-3ea7ef25415e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:07.887399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b8381249-fad0-4fed-9952-93889b2d6748 None None] MFA Rules not processed for user `9b2db60c511f4fd29b772ca5fb014d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:07.887836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ea9cf-6990-4c76-bc51-3ea7ef25415e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:07.888589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b8381249-fad0-4fed-9952-93889b2d6748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:07.889166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ea9cf-6990-4c76-bc51-3ea7ef25415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:07.984493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-493ea9cf-6990-4c76-bc51-3ea7ef25415e None None] MFA Rules not processed for user `9a2afd9d1074460a9637f0ce67385a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:07.985751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-493ea9cf-6990-4c76-bc51-3ea7ef25415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:07.992299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 828/1674] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:46:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:08.150898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 847/1675] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:08.152265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8381249-fad0-4fed-9952-93889b2d6748 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:08.164491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:08.270988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8381249-fad0-4fed-9952-93889b2d6748 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:08.292284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459b19b-68c6-4155-a8bd-879f849f15c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:08.292284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459b19b-68c6-4155-a8bd-879f849f15c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:08.292284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459b19b-68c6-4155-a8bd-879f849f15c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:08.292571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459b19b-68c6-4155-a8bd-879f849f15c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:08.293094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459b19b-68c6-4155-a8bd-879f849f15c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:08.298829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459b19b-68c6-4155-a8bd-879f849f15c8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:08.345947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ea9cf-6990-4c76-bc51-3ea7ef25415e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:08.347545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-493ea9cf-6990-4c76-bc51-3ea7ef25415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:08.366641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ea9cf-6990-4c76-bc51-3ea7ef25415e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:08.383287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25052ae-d93b-4f95-8a0e-913ecb3490c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:08.384351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25052ae-d93b-4f95-8a0e-913ecb3490c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:08.384890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25052ae-d93b-4f95-8a0e-913ecb3490c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:08.385798 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25052ae-d93b-4f95-8a0e-913ecb3490c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:08.422314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 829/1676] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:08 2022] POST /identity/v3/projects => generated 387 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:08.427262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459b19b-68c6-4155-a8bd-879f849f15c8 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:08.440065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:08.445790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25052ae-d93b-4f95-8a0e-913ecb3490c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:08.452588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25052ae-d93b-4f95-8a0e-913ecb3490c1 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:08.500089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 848/1677] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:46:08.501680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4b61-3f31-4d52-a6dd-4dd5ef01e077 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:08.504309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4b61-3f31-4d52-a6dd-4dd5ef01e077 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:08.504614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4b61-3f31-4d52-a6dd-4dd5ef01e077 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:08.508942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 849/1678] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:46:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:46:08.545465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcec1f-60f9-4402-9b37-849149a07d53 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:08.547186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcec1f-60f9-4402-9b37-849149a07d53 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:08.547186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcec1f-60f9-4402-9b37-849149a07d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:08.608089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0dbcec1f-60f9-4402-9b37-849149a07d53 None None] MFA Rules not processed for user `87fd5580ed264a08a3ad31850e0a53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:08.609419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0dbcec1f-60f9-4402-9b37-849149a07d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:08.684441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459b19b-68c6-4155-a8bd-879f849f15c8 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:08.703422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f742-28d5-4a9b-b3fd-48fb7161d82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:08.703925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f742-28d5-4a9b-b3fd-48fb7161d82c admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:08.704297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f742-28d5-4a9b-b3fd-48fb7161d82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:08.704649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f742-28d5-4a9b-b3fd-48fb7161d82c admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:08.705423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607f742-28d5-4a9b-b3fd-48fb7161d82c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:08.707511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607f742-28d5-4a9b-b3fd-48fb7161d82c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:08.774049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 850/1679] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:46:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:08.796641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcec1f-60f9-4402-9b37-849149a07d53 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:08.810777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcec1f-60f9-4402-9b37-849149a07d53 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:08.819373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab0c53-6371-402b-ab6e-e684f7bde15a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:08.820336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0c53-6371-402b-ab6e-e684f7bde15a service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:08.820785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0c53-6371-402b-ab6e-e684f7bde15a service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:08.821650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab0c53-6371-402b-ab6e-e684f7bde15a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:08.829835 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 830/1680] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:08 2022] POST /identity/v3/users => generated 300 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:08.833243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f742-28d5-4a9b-b3fd-48fb7161d82c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:08.833767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab0c53-6371-402b-ab6e-e684f7bde15a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:08.835788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab0c53-6371-402b-ab6e-e684f7bde15a service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:08.852827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 851/1681] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:46:08.858617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f742-28d5-4a9b-b3fd-48fb7161d82c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:08.884121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46efdc8-3e41-4b22-b46b-3651c1fe2ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:08.889341 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46efdc8-3e41-4b22-b46b-3651c1fe2ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:08.889648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46efdc8-3e41-4b22-b46b-3651c1fe2ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:08.889939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46efdc8-3e41-4b22-b46b-3651c1fe2ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:08.890834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46efdc8-3e41-4b22-b46b-3651c1fe2ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:08.894653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46efdc8-3e41-4b22-b46b-3651c1fe2ed0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:08.937075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 831/1682] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:08.941059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab0c53-6371-402b-ab6e-e684f7bde15a service placement] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:08.962191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab0c53-6371-402b-ab6e-e684f7bde15a service placement] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:08.977525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56721366-1888-43aa-96f7-a9b051f4ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:08.979808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56721366-1888-43aa-96f7-a9b051f4ddc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:08.980250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56721366-1888-43aa-96f7-a9b051f4ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:08.982404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56721366-1888-43aa-96f7-a9b051f4ddc4 admin admin] PATH_INFO: `/v3/projects/9d885a6540bf41abade4c61d78669a31/users/46b6ae0329dd49d4ae20d00e78119195/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:09.024738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56721366-1888-43aa-96f7-a9b051f4ddc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d885a6540bf41abade4c61d78669a31, user_id=46b6ae0329dd49d4ae20d00e78119195, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:09.034260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56721366-1888-43aa-96f7-a9b051f4ddc4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:09.079269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46efdc8-3e41-4b22-b46b-3651c1fe2ed0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:09.081121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f46efdc8-3e41-4b22-b46b-3651c1fe2ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:09.106323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46efdc8-3e41-4b22-b46b-3651c1fe2ed0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:09.120104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:09.121329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:09.121767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:09.122213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] PATH_INFO: `/v3/users/2e90e00230bf4a49bf80366bab518798` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:09.128591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e90e00230bf4a49bf80366bab518798)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:09.130876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:09.161778 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 852/1683] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:08 2022] PUT /identity/v3/projects/9d885a6540bf41abade4c61d78669a31/users/46b6ae0329dd49d4ae20d00e78119195/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:09.162944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56721366-1888-43aa-96f7-a9b051f4ddc4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:09.238333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:09.302488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56721366-1888-43aa-96f7-a9b051f4ddc4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:09.311375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d01e-519a-482b-9d1e-2d0efa4bbba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:09.312400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d01e-519a-482b-9d1e-2d0efa4bbba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:09.312400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d01e-519a-482b-9d1e-2d0efa4bbba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:09.312624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c928d01e-519a-482b-9d1e-2d0efa4bbba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:09.313351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928d01e-519a-482b-9d1e-2d0efa4bbba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:09.320006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c928d01e-519a-482b-9d1e-2d0efa4bbba4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:09.343847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 853/1684] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:09.347883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d01e-519a-482b-9d1e-2d0efa4bbba4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:09.369622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c928d01e-519a-482b-9d1e-2d0efa4bbba4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:09.378065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e90e00230bf4a49bf80366bab518798'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:09.381839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49b85f-32a8-4d2d-8a7b-cbf6b8f84556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:09.382598 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e90e00230bf4a49bf80366bab518798'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:09.384255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b85f-32a8-4d2d-8a7b-cbf6b8f84556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:09.385680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b85f-32a8-4d2d-8a7b-cbf6b8f84556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:09.385976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49b85f-32a8-4d2d-8a7b-cbf6b8f84556 admin admin] PATH_INFO: `/v3/projects/9d885a6540bf41abade4c61d78669a31/users/46b6ae0329dd49d4ae20d00e78119195/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:09.393510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49b85f-32a8-4d2d-8a7b-cbf6b8f84556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d885a6540bf41abade4c61d78669a31, user_id=46b6ae0329dd49d4ae20d00e78119195, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:09.401414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49b85f-32a8-4d2d-8a7b-cbf6b8f84556 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:09.428384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e90e00230bf4a49bf80366bab518798'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:09.437313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 854/1685] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:09 2022] PUT /identity/v3/projects/9d885a6540bf41abade4c61d78669a31/users/46b6ae0329dd49d4ae20d00e78119195/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:09.440799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255242-92a4-4505-8ea3-7bc5f6fc11c0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:09.441356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255242-92a4-4505-8ea3-7bc5f6fc11c0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:09.441863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64255242-92a4-4505-8ea3-7bc5f6fc11c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:09.464842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e90e00230bf4a49bf80366bab518798'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:09.500802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-64255242-92a4-4505-8ea3-7bc5f6fc11c0 None None] MFA Rules not processed for user `46b6ae0329dd49d4ae20d00e78119195`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:09.502550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-64255242-92a4-4505-8ea3-7bc5f6fc11c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:09.556731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e90e00230bf4a49bf80366bab518798'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:09.566490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 832/1686] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:09 2022] DELETE /identity/v3/users/2e90e00230bf4a49bf80366bab518798 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:09.706909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 855/1687] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:09.725907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:09.729226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:09.869259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:09.880283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d2968-e3d8-46c5-bf48-54a9bbef3354 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:09.885147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a9b1-81a6-4acb-989f-61deca2db123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:09.886183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a9b1-81a6-4acb-989f-61deca2db123 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:09.886691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a9b1-81a6-4acb-989f-61deca2db123 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:09.887098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a9b1-81a6-4acb-989f-61deca2db123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:10.033396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631a9b1-81a6-4acb-989f-61deca2db123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:10.038586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631a9b1-81a6-4acb-989f-61deca2db123 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:10.064022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 833/1688] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:10.965223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255242-92a4-4505-8ea3-7bc5f6fc11c0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:10.968649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-64255242-92a4-4505-8ea3-7bc5f6fc11c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:11.209294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64255242-92a4-4505-8ea3-7bc5f6fc11c0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:11.355598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:11.407257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:11.408833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:11.408833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:11.408833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] PATH_INFO: `/v3/projects/4f3b533ed21a430b926f90f84f291269` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:11.423807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3b533ed21a430b926f90f84f291269)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:11.428968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:11.573583 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a9b1-81a6-4acb-989f-61deca2db123 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:11.579413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b631a9b1-81a6-4acb-989f-61deca2db123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:11.683431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3b533ed21a430b926f90f84f291269', 'request_id': 'req-8e60167b-8da8-490d-98da-6b61278c7ce9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:11.815183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3b533ed21a430b926f90f84f291269', 'request_id': 'req-8e60167b-8da8-490d-98da-6b61278c7ce9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:11.827173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3b533ed21a430b926f90f84f291269', 'request_id': 'req-8e60167b-8da8-490d-98da-6b61278c7ce9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:11.878286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] The token cache is being invalidate because project 4f3b533ed21a430b926f90f84f291269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:11.893285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:11.896285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:11.898613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 856/1689] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:10 2022] DELETE /identity/v3/projects/4f3b533ed21a430b926f90f84f291269 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:11.909073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:11.917547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a9b1-81a6-4acb-989f-61deca2db123 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:11.918049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:12.148652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01633b35-844b-42a6-be38-3cd1ef276604 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:12.149329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01633b35-844b-42a6-be38-3cd1ef276604 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:12.149763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01633b35-844b-42a6-be38-3cd1ef276604 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:12.150702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01633b35-844b-42a6-be38-3cd1ef276604 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:12.156388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-01633b35-844b-42a6-be38-3cd1ef276604 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:12.167528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60167b-8da8-490d-98da-6b61278c7ce9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:12.185350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:12.186526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:12.187031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:12.187486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] PATH_INFO: `/v3/users/c4dbebacd98349ffb2f6d2f3ee78548d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:12.188514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01633b35-844b-42a6-be38-3cd1ef276604 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:12.189334 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4dbebacd98349ffb2f6d2f3ee78548d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:12.190532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:46:12.190532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 09:46:12.190532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: Jun 24 09:46:12.195725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:12.195974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01633b35-844b-42a6-be38-3cd1ef276604 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:12.231129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 834/1690] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:12.237063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6e43-35cd-4d10-8805-33d7f29e2df8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:12.237857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6e43-35cd-4d10-8805-33d7f29e2df8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:12.238281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6e43-35cd-4d10-8805-33d7f29e2df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:12.292136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b13b6e43-35cd-4d10-8805-33d7f29e2df8 None None] MFA Rules not processed for user `2cdef290abf8487ab370969a5e5b76c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:12.294451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b13b6e43-35cd-4d10-8805-33d7f29e2df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:12.404990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:12.512499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 835/1691] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:12.513687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b6e43-35cd-4d10-8805-33d7f29e2df8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:12.515517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b13b6e43-35cd-4d10-8805-33d7f29e2df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:12.614251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4dbebacd98349ffb2f6d2f3ee78548d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:12.725346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4dbebacd98349ffb2f6d2f3ee78548d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:12.802627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b6e43-35cd-4d10-8805-33d7f29e2df8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:12.828641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4dbebacd98349ffb2f6d2f3ee78548d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:12.828641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4dbebacd98349ffb2f6d2f3ee78548d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:12.830099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bba12-a7c8-4512-95d9-b291d68863bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:12.831078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bba12-a7c8-4512-95d9-b291d68863bc service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:12.831426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bba12-a7c8-4512-95d9-b291d68863bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:12.831723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bba12-a7c8-4512-95d9-b291d68863bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:12.834650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b40bba12-a7c8-4512-95d9-b291d68863bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:12.840383 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:12.848202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4dbebacd98349ffb2f6d2f3ee78548d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:12.868303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 857/1692] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:11 2022] DELETE /identity/v3/users/c4dbebacd98349ffb2f6d2f3ee78548d => generated 0 bytes in 963 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:12.877171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:12.883545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:12.987691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bba12-a7c8-4512-95d9-b291d68863bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:12.990749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bba12-a7c8-4512-95d9-b291d68863bc service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:13.007984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 836/1693] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:13.009670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5260ad-4432-42be-b0a5-87f821af5900 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:13.010109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5260ad-4432-42be-b0a5-87f821af5900 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:13.010808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5260ad-4432-42be-b0a5-87f821af5900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:13.024987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265940d7-2b22-4840-9e1c-f5487b78ea0e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:13.039757 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:13.042055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:13.042558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:13.043021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] PATH_INFO: `/v3/users/592ae6e403fe4552b181dd700ae14318` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:13.046275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=592ae6e403fe4552b181dd700ae14318)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:13.048638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:13.048758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4f5260ad-4432-42be-b0a5-87f821af5900 None None] MFA Rules not processed for user `7193035b7e334898a9d4566a8415ebef`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:13.050169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4f5260ad-4432-42be-b0a5-87f821af5900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:13.213601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 837/1694] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:13.217415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6821-4e4c-44b4-bba9-ffe2275fce9c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:13.218676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6821-4e4c-44b4-bba9-ffe2275fce9c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:13.219049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aee6821-4e4c-44b4-bba9-ffe2275fce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:13.257004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3aee6821-4e4c-44b4-bba9-ffe2275fce9c None None] MFA Rules not processed for user `7193035b7e334898a9d4566a8415ebef`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:13.258528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3aee6821-4e4c-44b4-bba9-ffe2275fce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:13.273220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 838/1695] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:13.283193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6821-4e4c-44b4-bba9-ffe2275fce9c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:13.285457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3aee6821-4e4c-44b4-bba9-ffe2275fce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:13.313675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:13.471824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aee6821-4e4c-44b4-bba9-ffe2275fce9c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:13.472504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592ae6e403fe4552b181dd700ae14318'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:13.479422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b143-dbef-42cd-91cc-9eea74ac04a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:13.480348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b143-dbef-42cd-91cc-9eea74ac04a2 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:13.484982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b143-dbef-42cd-91cc-9eea74ac04a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:13.485432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b143-dbef-42cd-91cc-9eea74ac04a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:13.516013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b143-dbef-42cd-91cc-9eea74ac04a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:13.518698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b143-dbef-42cd-91cc-9eea74ac04a2 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:13.519009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592ae6e403fe4552b181dd700ae14318'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:13.541933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 839/1696] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:46:13.608393 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592ae6e403fe4552b181dd700ae14318'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:13.609144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592ae6e403fe4552b181dd700ae14318'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:13.625295 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592ae6e403fe4552b181dd700ae14318'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:13.636168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 858/1697] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:12 2022] DELETE /identity/v3/users/592ae6e403fe4552b181dd700ae14318 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:13.638748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645957-6a1b-4dfd-b547-7883803ee252 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:13.639146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645957-6a1b-4dfd-b547-7883803ee252 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:13.639813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3645957-6a1b-4dfd-b547-7883803ee252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:13.710951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c3645957-6a1b-4dfd-b547-7883803ee252 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:13.726647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c3645957-6a1b-4dfd-b547-7883803ee252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:13.929694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:13.934141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:14.003654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 840/1698] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:14.071523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d440e57-a25e-4cbd-9d21-4feaf310fa97 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:14.074772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:14.075941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:14.076637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:14.077133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] PATH_INFO: `/v3/projects/1dbfd781353a4bba96f8a3b3974a95fe` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:14.086585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dbfd781353a4bba96f8a3b3974a95fe)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:14.104356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:14.321363 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dbfd781353a4bba96f8a3b3974a95fe', 'request_id': 'req-0d9b16a8-9073-4d45-98a2-57d4fe575b35'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:14.342278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3645957-6a1b-4dfd-b547-7883803ee252 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:14.344904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c3645957-6a1b-4dfd-b547-7883803ee252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:14.398222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dbfd781353a4bba96f8a3b3974a95fe', 'request_id': 'req-0d9b16a8-9073-4d45-98a2-57d4fe575b35'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:14.409491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dbfd781353a4bba96f8a3b3974a95fe', 'request_id': 'req-0d9b16a8-9073-4d45-98a2-57d4fe575b35'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:14.439378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] The token cache is being invalidate because project 1dbfd781353a4bba96f8a3b3974a95fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:14.439686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:14.446683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d9b16a8-9073-4d45-98a2-57d4fe575b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:14.455217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 859/1699] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:13 2022] DELETE /identity/v3/projects/1dbfd781353a4bba96f8a3b3974a95fe => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:14.458900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381f5a-5802-4ef1-9e47-5deb02b80844 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:14.459336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381f5a-5802-4ef1-9e47-5deb02b80844 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:14.459944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8381f5a-5802-4ef1-9e47-5deb02b80844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:14.514654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b8381f5a-5802-4ef1-9e47-5deb02b80844 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:14.521230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:14.524751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b8381f5a-5802-4ef1-9e47-5deb02b80844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:14.567939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3645957-6a1b-4dfd-b547-7883803ee252 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:14.697749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e212e-fd1f-4f43-9214-dcb4ccc0386c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:14.717069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e212e-fd1f-4f43-9214-dcb4ccc0386c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:14.717595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e212e-fd1f-4f43-9214-dcb4ccc0386c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:14.717892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e212e-fd1f-4f43-9214-dcb4ccc0386c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:14.723106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-702e212e-fd1f-4f43-9214-dcb4ccc0386c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:14.744030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:14.935189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e212e-fd1f-4f43-9214-dcb4ccc0386c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:14.936808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e212e-fd1f-4f43-9214-dcb4ccc0386c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:14.959021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 841/1700] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:14.960405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162076-d0f3-4dfa-bd46-8747c7a6b4a7 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:14.960690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162076-d0f3-4dfa-bd46-8747c7a6b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:14.961011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162076-d0f3-4dfa-bd46-8747c7a6b4a7 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:14.962376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 842/1701] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 09:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:46:14.974406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9871-1a5b-43a7-b80d-477362edc798 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:14.974406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9871-1a5b-43a7-b80d-477362edc798 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:14.974406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9871-1a5b-43a7-b80d-477362edc798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:15.020616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-519e9871-1a5b-43a7-b80d-477362edc798 None None] MFA Rules not processed for user `9b2db60c511f4fd29b772ca5fb014d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:15.021807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 860/1702] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 565 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:15.023045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-519e9871-1a5b-43a7-b80d-477362edc798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:15.031974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa559f-c3f3-4536-a8c7-66f578fef973 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:15.034525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa559f-c3f3-4536-a8c7-66f578fef973 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:15.034525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa559f-c3f3-4536-a8c7-66f578fef973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:15.050351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 843/1703] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:46:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:15.108727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ccaa559f-c3f3-4536-a8c7-66f578fef973 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:15.111784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ccaa559f-c3f3-4536-a8c7-66f578fef973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:15.140626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 861/1704] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:15.144070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9871-1a5b-43a7-b80d-477362edc798 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:15.161053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9871-1a5b-43a7-b80d-477362edc798 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:15.167900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea67b8a-3a0c-45a1-bd29-fbd63c4e5fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:15.168853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea67b8a-3a0c-45a1-bd29-fbd63c4e5fff admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:15.169298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea67b8a-3a0c-45a1-bd29-fbd63c4e5fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:15.169867 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea67b8a-3a0c-45a1-bd29-fbd63c4e5fff admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:15.172218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea67b8a-3a0c-45a1-bd29-fbd63c4e5fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:46:15.172703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea67b8a-3a0c-45a1-bd29-fbd63c4e5fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:15.175505 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea67b8a-3a0c-45a1-bd29-fbd63c4e5fff admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:15.216291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 844/1705] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:46:15.221173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa559f-c3f3-4536-a8c7-66f578fef973 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:15.234266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa559f-c3f3-4536-a8c7-66f578fef973 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:15.254651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748abaf-22e9-4a29-8e47-53fb2da568ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:15.255371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748abaf-22e9-4a29-8e47-53fb2da568ab admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:15.255663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748abaf-22e9-4a29-8e47-53fb2da568ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:15.257382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748abaf-22e9-4a29-8e47-53fb2da568ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:15.257382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748abaf-22e9-4a29-8e47-53fb2da568ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:15.258638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748abaf-22e9-4a29-8e47-53fb2da568ab admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:15.272435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e97e52-79e6-48ec-8ed6-33c720fa7db6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:15.272732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e97e52-79e6-48ec-8ed6-33c720fa7db6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:15.273020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e97e52-79e6-48ec-8ed6-33c720fa7db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:15.354182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a0e97e52-79e6-48ec-8ed6-33c720fa7db6 None None] MFA Rules not processed for user `4a762aa672f5465da0f7cbc67ea7af9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:15.355391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a0e97e52-79e6-48ec-8ed6-33c720fa7db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:15.414515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 862/1706] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:15 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:15.414515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748abaf-22e9-4a29-8e47-53fb2da568ab admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:15.424772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1748abaf-22e9-4a29-8e47-53fb2da568ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:15.608954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 845/1707] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:15.617357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e97e52-79e6-48ec-8ed6-33c720fa7db6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:15.653421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e97e52-79e6-48ec-8ed6-33c720fa7db6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:15.667122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748abaf-22e9-4a29-8e47-53fb2da568ab admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:15.694222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8add6c-d3a9-4657-91f4-637e0c4cdb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:15.694803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8add6c-d3a9-4657-91f4-637e0c4cdb24 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:15.695124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8add6c-d3a9-4657-91f4-637e0c4cdb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:15.695405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8add6c-d3a9-4657-91f4-637e0c4cdb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:15.718483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8add6c-d3a9-4657-91f4-637e0c4cdb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:15.724986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8add6c-d3a9-4657-91f4-637e0c4cdb24 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:15.779913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 863/1708] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:15.783377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ad5d6-190f-4fc6-a7e0-46a5886e10a7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:15.786507 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ad5d6-190f-4fc6-a7e0-46a5886e10a7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:15.787419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461ad5d6-190f-4fc6-a7e0-46a5886e10a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:15.876515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac61b0-ff52-4718-81b7-a6d7f703040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:15.879792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac61b0-ff52-4718-81b7-a6d7f703040e admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:15.886693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac61b0-ff52-4718-81b7-a6d7f703040e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:15.887235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac61b0-ff52-4718-81b7-a6d7f703040e admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:15.889860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac61b0-ff52-4718-81b7-a6d7f703040e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:15.892097 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac61b0-ff52-4718-81b7-a6d7f703040e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:15.959053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-461ad5d6-190f-4fc6-a7e0-46a5886e10a7 None None] MFA Rules not processed for user `38331c36830a426cbc41b370c707e44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:15.966300 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-461ad5d6-190f-4fc6-a7e0-46a5886e10a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:16.011417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:16.017194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 846/1709] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:15 2022] POST /identity/v3/users => generated 284 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:16.018289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac61b0-ff52-4718-81b7-a6d7f703040e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:16.025947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-09ac61b0-ff52-4718-81b7-a6d7f703040e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:16.046476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:16.164620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 864/1710] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:16.164620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ad5d6-190f-4fc6-a7e0-46a5886e10a7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:16.194141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461ad5d6-190f-4fc6-a7e0-46a5886e10a7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:16.207129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aef1c-0241-45e3-b526-9305e725890c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:16.208143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aef1c-0241-45e3-b526-9305e725890c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:16.208568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aef1c-0241-45e3-b526-9305e725890c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:16.209013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aef1c-0241-45e3-b526-9305e725890c admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:16.212466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3aef1c-0241-45e3-b526-9305e725890c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:16.217566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3aef1c-0241-45e3-b526-9305e725890c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:16.240999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 865/1711] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:16.244997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aef1c-0241-45e3-b526-9305e725890c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:16.280399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aef1c-0241-45e3-b526-9305e725890c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:16.297352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b843e3-54af-446d-8381-c15c0c47951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:16.299119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b843e3-54af-446d-8381-c15c0c47951a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:16.299555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b843e3-54af-446d-8381-c15c0c47951a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:16.308799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b843e3-54af-446d-8381-c15c0c47951a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:16.308799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b843e3-54af-446d-8381-c15c0c47951a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:16.308799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b843e3-54af-446d-8381-c15c0c47951a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:16.330416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac61b0-ff52-4718-81b7-a6d7f703040e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:16.337464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 866/1712] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:16.341988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b843e3-54af-446d-8381-c15c0c47951a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:16.363110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a335ff-af89-4d7c-b627-9621df64ca80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:16.364087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a335ff-af89-4d7c-b627-9621df64ca80 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:16.366271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a335ff-af89-4d7c-b627-9621df64ca80 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:16.366895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a335ff-af89-4d7c-b627-9621df64ca80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:16.375872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b843e3-54af-446d-8381-c15c0c47951a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:16.419132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45381e-91da-4aed-9402-30554396d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:16.420075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45381e-91da-4aed-9402-30554396d4ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:16.420361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45381e-91da-4aed-9402-30554396d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:16.420690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a45381e-91da-4aed-9402-30554396d4ac admin admin] PATH_INFO: `/v3/projects/962b0e13bc754488a60871dff95b1829/users/2e83e38a527f4a37b9b5e3b77cae5e19/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:16.503571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45381e-91da-4aed-9402-30554396d4ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=962b0e13bc754488a60871dff95b1829, user_id=2e83e38a527f4a37b9b5e3b77cae5e19, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:16.513097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a45381e-91da-4aed-9402-30554396d4ac admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:16.544004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a335ff-af89-4d7c-b627-9621df64ca80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:16.545675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a335ff-af89-4d7c-b627-9621df64ca80 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:16.566509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 847/1713] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:16.649392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37332f-e10f-4d0d-aa57-be25c084b550 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:16.649919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37332f-e10f-4d0d-aa57-be25c084b550 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:16.650382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37332f-e10f-4d0d-aa57-be25c084b550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:16.651102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 867/1714] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:16 2022] PUT /identity/v3/projects/962b0e13bc754488a60871dff95b1829/users/2e83e38a527f4a37b9b5e3b77cae5e19/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:16.724854 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2a37332f-e10f-4d0d-aa57-be25c084b550 None None] MFA Rules not processed for user `2e83e38a527f4a37b9b5e3b77cae5e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:16.726347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2a37332f-e10f-4d0d-aa57-be25c084b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:16.945558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 848/1715] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:16.954766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45381e-91da-4aed-9402-30554396d4ac admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:16.972330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37332f-e10f-4d0d-aa57-be25c084b550 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:16.973883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2a37332f-e10f-4d0d-aa57-be25c084b550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:17.221418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:17.254392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a45381e-91da-4aed-9402-30554396d4ac admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:17.263248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d646072-2cd0-43bd-8d6e-d61d9a9cb883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:17.263944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d646072-2cd0-43bd-8d6e-d61d9a9cb883 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:17.264233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d646072-2cd0-43bd-8d6e-d61d9a9cb883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:17.264512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d646072-2cd0-43bd-8d6e-d61d9a9cb883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:17.265231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d646072-2cd0-43bd-8d6e-d61d9a9cb883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:17.267384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d646072-2cd0-43bd-8d6e-d61d9a9cb883 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:17.335356 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37332f-e10f-4d0d-aa57-be25c084b550 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:17.357212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:17.358217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:17.358683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:17.359190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] PATH_INFO: `/v3/projects/06ea8a9bced04406a6f5a65c769c06fe` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:17.364527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ea8a9bced04406a6f5a65c769c06fe)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:17.366348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:46:17.366348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 09:46:17.366348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: Jun 24 09:46:17.368189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:17.422870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 868/1716] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:16 2022] POST /identity/v3/projects => generated 367 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:17.425482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d646072-2cd0-43bd-8d6e-d61d9a9cb883 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:17.444876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4d646072-2cd0-43bd-8d6e-d61d9a9cb883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:17.644997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:17.705137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d646072-2cd0-43bd-8d6e-d61d9a9cb883 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:17.706882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ea8a9bced04406a6f5a65c769c06fe', 'request_id': 'req-b2f63379-28a4-45b0-9380-f6645710d91e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:17.736522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ea8a9bced04406a6f5a65c769c06fe', 'request_id': 'req-b2f63379-28a4-45b0-9380-f6645710d91e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:17.850371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ea8a9bced04406a6f5a65c769c06fe', 'request_id': 'req-b2f63379-28a4-45b0-9380-f6645710d91e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:17.911255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] The token cache is being invalidate because project 06ea8a9bced04406a6f5a65c769c06fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:17.911255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:17.913233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:17.922559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 849/1717] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:16 2022] DELETE /identity/v3/projects/06ea8a9bced04406a6f5a65c769c06fe => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:17.923826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:17.926133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:17.968763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a6d7e-0020-4ae8-8d25-08a136157f4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:17.968763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a6d7e-0020-4ae8-8d25-08a136157f4e service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:17.968763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a6d7e-0020-4ae8-8d25-08a136157f4e service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:17.968763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a6d7e-0020-4ae8-8d25-08a136157f4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:17.987101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2e4a6d7e-0020-4ae8-8d25-08a136157f4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:18.173433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a6d7e-0020-4ae8-8d25-08a136157f4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:18.177629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a6d7e-0020-4ae8-8d25-08a136157f4e service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:18.179957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f63379-28a4-45b0-9380-f6645710d91e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:18.197932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 869/1718] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:18.206113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b04a5b-06cb-4e59-b121-a47d3b5bb9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:18.206909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b04a5b-06cb-4e59-b121-a47d3b5bb9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:18.207207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b04a5b-06cb-4e59-b121-a47d3b5bb9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:18.207493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b04a5b-06cb-4e59-b121-a47d3b5bb9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:18.208295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b04a5b-06cb-4e59-b121-a47d3b5bb9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:18.209007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443192e9-3006-4095-bf7b-817081c0ed0a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:18.209255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443192e9-3006-4095-bf7b-817081c0ed0a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:18.209546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443192e9-3006-4095-bf7b-817081c0ed0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:18.221053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b04a5b-06cb-4e59-b121-a47d3b5bb9a3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:18.234158 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-443192e9-3006-4095-bf7b-817081c0ed0a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:18.235417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-443192e9-3006-4095-bf7b-817081c0ed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:18.261217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 870/1719] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:18.270655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae19969-5e8c-4fdf-b147-50aeecf57a6b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:18.271248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae19969-5e8c-4fdf-b147-50aeecf57a6b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:18.271772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae19969-5e8c-4fdf-b147-50aeecf57a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:18.331412 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4ae19969-5e8c-4fdf-b147-50aeecf57a6b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:18.337476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4ae19969-5e8c-4fdf-b147-50aeecf57a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:18.384576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 850/1720] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:17 2022] POST /identity/v3/users => generated 290 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:18.388713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b04a5b-06cb-4e59-b121-a47d3b5bb9a3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:18.413265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 871/1721] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:18.418116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae19969-5e8c-4fdf-b147-50aeecf57a6b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:18.418278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b04a5b-06cb-4e59-b121-a47d3b5bb9a3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:18.423515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db6fe8-6c32-47b3-b547-0bdd98bde02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:18.425414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db6fe8-6c32-47b3-b547-0bdd98bde02a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:18.425573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db6fe8-6c32-47b3-b547-0bdd98bde02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:18.425890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3db6fe8-6c32-47b3-b547-0bdd98bde02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:18.429656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db6fe8-6c32-47b3-b547-0bdd98bde02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:18.435120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3db6fe8-6c32-47b3-b547-0bdd98bde02a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:18.453002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 851/1722] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:18.457256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db6fe8-6c32-47b3-b547-0bdd98bde02a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:18.470768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3db6fe8-6c32-47b3-b547-0bdd98bde02a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:18.475636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae19969-5e8c-4fdf-b147-50aeecf57a6b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:18.475911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f344bb-d41e-4d60-9c5c-7d7808db5468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:18.477404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f344bb-d41e-4d60-9c5c-7d7808db5468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:18.477404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f344bb-d41e-4d60-9c5c-7d7808db5468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:18.477404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f344bb-d41e-4d60-9c5c-7d7808db5468 admin admin] PATH_INFO: `/v3/projects/d0f1c1247bf8425ebdb7c228f04ed264/users/4a4c675062df4153b7cd4a0605a5ef03/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:18.491285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee146c4d-66e8-4faa-b9e8-ef218c698957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:18.492024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee146c4d-66e8-4faa-b9e8-ef218c698957 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:18.492316 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee146c4d-66e8-4faa-b9e8-ef218c698957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:18.492642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee146c4d-66e8-4faa-b9e8-ef218c698957 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:18.493422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee146c4d-66e8-4faa-b9e8-ef218c698957 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:46:18.493733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee146c4d-66e8-4faa-b9e8-ef218c698957 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:18.497518 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee146c4d-66e8-4faa-b9e8-ef218c698957 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:18.532430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f344bb-d41e-4d60-9c5c-7d7808db5468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f1c1247bf8425ebdb7c228f04ed264, user_id=4a4c675062df4153b7cd4a0605a5ef03, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:18.567272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f344bb-d41e-4d60-9c5c-7d7808db5468 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:18.577243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 872/1723] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:46:18.589639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee146c4d-66e8-4faa-b9e8-ef218c698957 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:18.629286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee146c4d-66e8-4faa-b9e8-ef218c698957 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:18.683747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7f027-4d83-45d3-bdb6-16f113e44dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:18.684472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7f027-4d83-45d3-bdb6-16f113e44dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:18.685666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7f027-4d83-45d3-bdb6-16f113e44dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:18.685948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7f027-4d83-45d3-bdb6-16f113e44dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:18.686664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7f027-4d83-45d3-bdb6-16f113e44dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:18.688649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 852/1724] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:18 2022] PUT /identity/v3/projects/d0f1c1247bf8425ebdb7c228f04ed264/users/4a4c675062df4153b7cd4a0605a5ef03/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:18.693673 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f344bb-d41e-4d60-9c5c-7d7808db5468 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:18.700249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7f027-4d83-45d3-bdb6-16f113e44dd5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:18.765454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:18.842996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 873/1725] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:18 2022] POST /identity/v3/projects => generated 373 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:46:18.846655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83099b17-dcde-4a95-b17e-6b34c1969ebf None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:18.846975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83099b17-dcde-4a95-b17e-6b34c1969ebf None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:18.847279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83099b17-dcde-4a95-b17e-6b34c1969ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:18.886819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f344bb-d41e-4d60-9c5c-7d7808db5468 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:18.923679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-83099b17-dcde-4a95-b17e-6b34c1969ebf None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:18.926229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-83099b17-dcde-4a95-b17e-6b34c1969ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:19.055962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:19.075815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3007ab-0978-4d0e-93c5-94836f4567ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:19.076540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3007ab-0978-4d0e-93c5-94836f4567ae admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:19.076808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3007ab-0978-4d0e-93c5-94836f4567ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:19.077051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3007ab-0978-4d0e-93c5-94836f4567ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:19.078393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3007ab-0978-4d0e-93c5-94836f4567ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:19.083275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3007ab-0978-4d0e-93c5-94836f4567ae admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:19.116756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 853/1726] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:19.116756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3007ab-0978-4d0e-93c5-94836f4567ae admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:19.144990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3007ab-0978-4d0e-93c5-94836f4567ae admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:19.162133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9c604-6f26-457a-b7d7-dbca8b0f2783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:19.163170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9c604-6f26-457a-b7d7-dbca8b0f2783 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:19.163627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9c604-6f26-457a-b7d7-dbca8b0f2783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:19.164068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9c604-6f26-457a-b7d7-dbca8b0f2783 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:19.164917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9c604-6f26-457a-b7d7-dbca8b0f2783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:19.167196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9c604-6f26-457a-b7d7-dbca8b0f2783 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:19.175342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 874/1727] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:19.195031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83099b17-dcde-4a95-b17e-6b34c1969ebf None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:19.216525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83099b17-dcde-4a95-b17e-6b34c1969ebf None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:19.239939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59607a-5712-4152-8f98-26fdcc6fc798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:19.241210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59607a-5712-4152-8f98-26fdcc6fc798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:19.243284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59607a-5712-4152-8f98-26fdcc6fc798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:19.243804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59607a-5712-4152-8f98-26fdcc6fc798 admin admin] PATH_INFO: `/v3/projects/d0f1c1247bf8425ebdb7c228f04ed264/users/4a4c675062df4153b7cd4a0605a5ef03/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:19.250207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59607a-5712-4152-8f98-26fdcc6fc798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f1c1247bf8425ebdb7c228f04ed264, user_id=4a4c675062df4153b7cd4a0605a5ef03, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:19.254625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59607a-5712-4152-8f98-26fdcc6fc798 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:19.280446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 854/1728] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:19 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:19.284637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9c604-6f26-457a-b7d7-dbca8b0f2783 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:19.333625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9c604-6f26-457a-b7d7-dbca8b0f2783 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:19.335971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 875/1729] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:19 2022] PUT /identity/v3/projects/d0f1c1247bf8425ebdb7c228f04ed264/users/4a4c675062df4153b7cd4a0605a5ef03/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:19.340808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c982-eeeb-4047-81c2-2bbf9f5b7fc4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:19.343469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c982-eeeb-4047-81c2-2bbf9f5b7fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:19.343758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897c982-eeeb-4047-81c2-2bbf9f5b7fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:19.433609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1897c982-eeeb-4047-81c2-2bbf9f5b7fc4 None None] MFA Rules not processed for user `4a4c675062df4153b7cd4a0605a5ef03`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:19.434808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1897c982-eeeb-4047-81c2-2bbf9f5b7fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:19.455041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8830a8-675c-4afc-8601-38b58b3d5746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:19.455935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8830a8-675c-4afc-8601-38b58b3d5746 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:19.456305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8830a8-675c-4afc-8601-38b58b3d5746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:19.456927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8830a8-675c-4afc-8601-38b58b3d5746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:19.457507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8830a8-675c-4afc-8601-38b58b3d5746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:19.460005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8830a8-675c-4afc-8601-38b58b3d5746 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:19.475282 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 855/1730] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:19.479399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8830a8-675c-4afc-8601-38b58b3d5746 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:19.524047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8830a8-675c-4afc-8601-38b58b3d5746 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:19.535633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe74e13-e908-440e-ac4f-9eddc1880224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:19.536332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe74e13-e908-440e-ac4f-9eddc1880224 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:19.536624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe74e13-e908-440e-ac4f-9eddc1880224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:19.536904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe74e13-e908-440e-ac4f-9eddc1880224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:19.537645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe74e13-e908-440e-ac4f-9eddc1880224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:19.539344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe74e13-e908-440e-ac4f-9eddc1880224 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:19.563548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 876/1731] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:19.566475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 856/1732] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:19.576151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c982-eeeb-4047-81c2-2bbf9f5b7fc4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:19.579970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1897c982-eeeb-4047-81c2-2bbf9f5b7fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:19.590366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe74e13-e908-440e-ac4f-9eddc1880224 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:19.613855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe74e13-e908-440e-ac4f-9eddc1880224 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:19.644018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc369f3-0faf-4d30-af3c-2fce781b6712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:19.656637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc369f3-0faf-4d30-af3c-2fce781b6712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:19.657331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc369f3-0faf-4d30-af3c-2fce781b6712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:19.657773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc369f3-0faf-4d30-af3c-2fce781b6712 admin admin] PATH_INFO: `/v3/projects/d76016047acb4418af74a1bea37457ba/users/099c5f9c851e4253bc865d87986063ce/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:19.724432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc369f3-0faf-4d30-af3c-2fce781b6712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76016047acb4418af74a1bea37457ba, user_id=099c5f9c851e4253bc865d87986063ce, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:19.724719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897c982-eeeb-4047-81c2-2bbf9f5b7fc4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:19.728966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc369f3-0faf-4d30-af3c-2fce781b6712 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:19.740564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aae0c4-0615-481e-ae78-c2ed79d417e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:19.741197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aae0c4-0615-481e-ae78-c2ed79d417e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:19.741486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aae0c4-0615-481e-ae78-c2ed79d417e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:19.741765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aae0c4-0615-481e-ae78-c2ed79d417e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:19.767808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aae0c4-0615-481e-ae78-c2ed79d417e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:19.769287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aae0c4-0615-481e-ae78-c2ed79d417e2 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:19.798188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 877/1733] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:19 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:19.800114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aae0c4-0615-481e-ae78-c2ed79d417e2 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:19.809584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-09aae0c4-0615-481e-ae78-c2ed79d417e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:19.899780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 857/1734] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:19 2022] PUT /identity/v3/projects/d76016047acb4418af74a1bea37457ba/users/099c5f9c851e4253bc865d87986063ce/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:19.901021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc369f3-0faf-4d30-af3c-2fce781b6712 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:19.905439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0cc369f3-0faf-4d30-af3c-2fce781b6712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:20.003117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aae0c4-0615-481e-ae78-c2ed79d417e2 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:20.245116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d8950-c100-414d-9113-a84fcc421d85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:20.246973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d8950-c100-414d-9113-a84fcc421d85 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:20.247431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d8950-c100-414d-9113-a84fcc421d85 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:20.250939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d8950-c100-414d-9113-a84fcc421d85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:20.257980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc369f3-0faf-4d30-af3c-2fce781b6712 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:20.271702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89dcde-d3cb-4891-9b49-275ab41e4950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:20.272399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dcde-d3cb-4891-9b49-275ab41e4950 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:20.272686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dcde-d3cb-4891-9b49-275ab41e4950 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:20.287917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dcde-d3cb-4891-9b49-275ab41e4950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:20.290628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ca89dcde-d3cb-4891-9b49-275ab41e4950 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:20.426447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d8950-c100-414d-9113-a84fcc421d85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:20.429161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d8950-c100-414d-9113-a84fcc421d85 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:20.457624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 878/1735] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:46:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:46:20.460624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755ffa5-bf1e-487d-bc8c-dac62cfc7df7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:20.461436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755ffa5-bf1e-487d-bc8c-dac62cfc7df7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:20.462264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755ffa5-bf1e-487d-bc8c-dac62cfc7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:20.535763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:20.591418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2755ffa5-bf1e-487d-bc8c-dac62cfc7df7 None None] MFA Rules not processed for user `cbb22c3df9e9452db19974f52d3ebb17`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:20.592744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2755ffa5-bf1e-487d-bc8c-dac62cfc7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:20.601887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89dcde-d3cb-4891-9b49-275ab41e4950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:20.609877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89dcde-d3cb-4891-9b49-275ab41e4950 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:20.654110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 858/1736] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:20.660130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce3b1a-205f-42ba-bd9b-61fc25fd931f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:20.664998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce3b1a-205f-42ba-bd9b-61fc25fd931f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:20.664998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce3b1a-205f-42ba-bd9b-61fc25fd931f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:20.789286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bdce3b1a-205f-42ba-bd9b-61fc25fd931f None None] MFA Rules not processed for user `099c5f9c851e4253bc865d87986063ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:20.795836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bdce3b1a-205f-42ba-bd9b-61fc25fd931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:20.799836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:21.016813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 879/1737] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 559 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:21.038632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755ffa5-bf1e-487d-bc8c-dac62cfc7df7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:21.042251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2755ffa5-bf1e-487d-bc8c-dac62cfc7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:21.139981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 859/1738] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:21.143519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce3b1a-205f-42ba-bd9b-61fc25fd931f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:21.445855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755ffa5-bf1e-487d-bc8c-dac62cfc7df7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:21.467528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:21.499265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f624af-5cfe-41e9-8f92-5d8f85735153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:21.508609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f624af-5cfe-41e9-8f92-5d8f85735153 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:21.514902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f624af-5cfe-41e9-8f92-5d8f85735153 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:21.515307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce3b1a-205f-42ba-bd9b-61fc25fd931f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:21.516411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f624af-5cfe-41e9-8f92-5d8f85735153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:21.533416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48886f03-9914-48b1-92a0-3e8e1b6d0ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:21.535587 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886f03-9914-48b1-92a0-3e8e1b6d0ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:21.535899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886f03-9914-48b1-92a0-3e8e1b6d0ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:21.536947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48886f03-9914-48b1-92a0-3e8e1b6d0ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:21.537688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886f03-9914-48b1-92a0-3e8e1b6d0ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:21.562337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:21.563155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48886f03-9914-48b1-92a0-3e8e1b6d0ad7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:21.585049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f624af-5cfe-41e9-8f92-5d8f85735153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:21.591937 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f624af-5cfe-41e9-8f92-5d8f85735153 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:21.656484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 880/1739] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:21.810091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 860/1740] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:21 2022] POST /identity/v3/projects => generated 373 bytes in 669 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:21.814256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f624af-5cfe-41e9-8f92-5d8f85735153 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:21.842102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f624af-5cfe-41e9-8f92-5d8f85735153 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:22.107540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd26cb-fbfa-459f-b284-bcbce19281f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:22.108495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd26cb-fbfa-459f-b284-bcbce19281f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:22.109763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd26cb-fbfa-459f-b284-bcbce19281f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:22.110537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd26cb-fbfa-459f-b284-bcbce19281f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:22.112423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd26cb-fbfa-459f-b284-bcbce19281f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:22.118064 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd26cb-fbfa-459f-b284-bcbce19281f9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:22.298088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 881/1741] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:21 2022] POST /identity/v3/users => generated 293 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:22.302537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48886f03-9914-48b1-92a0-3e8e1b6d0ad7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:22.322460 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48886f03-9914-48b1-92a0-3e8e1b6d0ad7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:22.346325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a465f-ca97-4e5a-964e-e74b124b276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:22.347063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a465f-ca97-4e5a-964e-e74b124b276a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:22.347355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a465f-ca97-4e5a-964e-e74b124b276a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:22.347640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a465f-ca97-4e5a-964e-e74b124b276a admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:22.356383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a465f-ca97-4e5a-964e-e74b124b276a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:22.358592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a465f-ca97-4e5a-964e-e74b124b276a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:22.409683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 861/1742] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:22.415831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd26cb-fbfa-459f-b284-bcbce19281f9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:22.438892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd26cb-fbfa-459f-b284-bcbce19281f9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:22.481896 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c96b4-f860-4bf3-94d7-9db3a2b335d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:22.484387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c96b4-f860-4bf3-94d7-9db3a2b335d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:22.484844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c96b4-f860-4bf3-94d7-9db3a2b335d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:22.485287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c96b4-f860-4bf3-94d7-9db3a2b335d9 admin admin] PATH_INFO: `/v3/projects/82126097603c401c8198e9b14bb06851/users/59fbf58525914416a8a17d3813b56e2a/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:22.583986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c96b4-f860-4bf3-94d7-9db3a2b335d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82126097603c401c8198e9b14bb06851, user_id=59fbf58525914416a8a17d3813b56e2a, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:22.603461 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c96b4-f860-4bf3-94d7-9db3a2b335d9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:22.883472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 882/1743] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:22 2022] PUT /identity/v3/projects/82126097603c401c8198e9b14bb06851/users/59fbf58525914416a8a17d3813b56e2a/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:22.889753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a465f-ca97-4e5a-964e-e74b124b276a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:22.909944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a465f-ca97-4e5a-964e-e74b124b276a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:23.161355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a194bf-9bf1-42a5-8179-5d41aa0567a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:23.165507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a194bf-9bf1-42a5-8179-5d41aa0567a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:23.166890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a194bf-9bf1-42a5-8179-5d41aa0567a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:23.167927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a194bf-9bf1-42a5-8179-5d41aa0567a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:23.169834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a194bf-9bf1-42a5-8179-5d41aa0567a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:23.174742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a194bf-9bf1-42a5-8179-5d41aa0567a8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:23.214052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 862/1744] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:23.218291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c96b4-f860-4bf3-94d7-9db3a2b335d9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:23.236084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c96b4-f860-4bf3-94d7-9db3a2b335d9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:23.255483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4c116-afec-45bc-b30e-158af6080f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:23.256420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4c116-afec-45bc-b30e-158af6080f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:23.256708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4c116-afec-45bc-b30e-158af6080f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:23.256988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4c116-afec-45bc-b30e-158af6080f0b admin admin] PATH_INFO: `/v3/projects/82126097603c401c8198e9b14bb06851/users/59fbf58525914416a8a17d3813b56e2a/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:23.259245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4c116-afec-45bc-b30e-158af6080f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=82126097603c401c8198e9b14bb06851, user_id=59fbf58525914416a8a17d3813b56e2a, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:23.263052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4c116-afec-45bc-b30e-158af6080f0b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:23.280939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 883/1745] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:23 2022] PUT /identity/v3/projects/82126097603c401c8198e9b14bb06851/users/59fbf58525914416a8a17d3813b56e2a/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:23.291872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd780986-ba4c-4434-99fd-01be8392a117 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:23.292492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd780986-ba4c-4434-99fd-01be8392a117 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:23.292980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd780986-ba4c-4434-99fd-01be8392a117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:23.354692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fd780986-ba4c-4434-99fd-01be8392a117 None None] MFA Rules not processed for user `59fbf58525914416a8a17d3813b56e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:23.357382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fd780986-ba4c-4434-99fd-01be8392a117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:23.623827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 863/1746] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:23.661432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4c116-afec-45bc-b30e-158af6080f0b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:23.802958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4c116-afec-45bc-b30e-158af6080f0b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:23.811034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee102e-4608-4bef-9eae-970d3d18d53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:23.814199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee102e-4608-4bef-9eae-970d3d18d53e service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:23.824080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee102e-4608-4bef-9eae-970d3d18d53e service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:23.824080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee102e-4608-4bef-9eae-970d3d18d53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:23.857307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee102e-4608-4bef-9eae-970d3d18d53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:23.864157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee102e-4608-4bef-9eae-970d3d18d53e service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:23.909642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 884/1747] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:46:24.424318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd780986-ba4c-4434-99fd-01be8392a117 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:24.435561 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd780986-ba4c-4434-99fd-01be8392a117 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:24.448514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10cab-c01c-4b65-ad5c-63c623a586bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:24.449495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10cab-c01c-4b65-ad5c-63c623a586bd service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:24.449943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10cab-c01c-4b65-ad5c-63c623a586bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:24.450372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d10cab-c01c-4b65-ad5c-63c623a586bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:24.581861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:24.661039 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d10cab-c01c-4b65-ad5c-63c623a586bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:24.662548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d10cab-c01c-4b65-ad5c-63c623a586bd service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:24.677545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782457-8b96-4053-94b3-08932540ac6f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:24.677545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782457-8b96-4053-94b3-08932540ac6f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:24.678082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19782457-8b96-4053-94b3-08932540ac6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:24.763189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 864/1748] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:24.775696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-19782457-8b96-4053-94b3-08932540ac6f None None] MFA Rules not processed for user `9b2db60c511f4fd29b772ca5fb014d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:24.776987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-19782457-8b96-4053-94b3-08932540ac6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:24.803186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:25.017594 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 885/1749] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Jun 24 09:46:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:25.159001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10cab-c01c-4b65-ad5c-63c623a586bd service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:25.161528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-11d10cab-c01c-4b65-ad5c-63c623a586bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:25.193253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d10cab-c01c-4b65-ad5c-63c623a586bd service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:25.217192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038ae77-c3bd-4c35-91b7-ea399f98893e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:25.220196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ae77-c3bd-4c35-91b7-ea399f98893e service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:25.220496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ae77-c3bd-4c35-91b7-ea399f98893e service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:25.220781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038ae77-c3bd-4c35-91b7-ea399f98893e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:25.273613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038ae77-c3bd-4c35-91b7-ea399f98893e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:25.277936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038ae77-c3bd-4c35-91b7-ea399f98893e service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:25.308925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 865/1750] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:26.464701 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19782457-8b96-4053-94b3-08932540ac6f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:26.572839 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c18f4-26f1-46d9-8707-7b223042607a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:26.574739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c18f4-26f1-46d9-8707-7b223042607a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:26.575247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c18f4-26f1-46d9-8707-7b223042607a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:26.655555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-199c18f4-26f1-46d9-8707-7b223042607a None None] MFA Rules not processed for user `4a762aa672f5465da0f7cbc67ea7af9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:26.667340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-199c18f4-26f1-46d9-8707-7b223042607a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:26.716719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19782457-8b96-4053-94b3-08932540ac6f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:26.759136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:26.762565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:26.762565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:26.762565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] PATH_INFO: `/v3/users/2e83e38a527f4a37b9b5e3b77cae5e19` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:26.770793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e83e38a527f4a37b9b5e3b77cae5e19)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:26.774167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:26.891652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 866/1751] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:27.080235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e83e38a527f4a37b9b5e3b77cae5e19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:27.123440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e83e38a527f4a37b9b5e3b77cae5e19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:27.211530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e83e38a527f4a37b9b5e3b77cae5e19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:27.212210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e83e38a527f4a37b9b5e3b77cae5e19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:27.231821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e83e38a527f4a37b9b5e3b77cae5e19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:27.247546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 886/1752] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:26 2022] DELETE /identity/v3/users/2e83e38a527f4a37b9b5e3b77cae5e19 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:27.252356 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d6289-37f8-4d37-9368-cc00d2acc0b4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:27.252967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d6289-37f8-4d37-9368-cc00d2acc0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:27.253515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d6289-37f8-4d37-9368-cc00d2acc0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:27.304575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-069d6289-37f8-4d37-9368-cc00d2acc0b4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:27.305786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-069d6289-37f8-4d37-9368-cc00d2acc0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:27.491147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 867/1753] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:27.599666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:27.604858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:27.696430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:27.737912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b9056-7227-46d9-b2d8-29cb8322d286 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:27.739517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbca3b-e758-4118-8509-54e390c336d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:27.741165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbca3b-e758-4118-8509-54e390c336d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:27.741511 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbca3b-e758-4118-8509-54e390c336d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:27.741910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbca3b-e758-4118-8509-54e390c336d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:27.757468 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbca3b-e758-4118-8509-54e390c336d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:27.759269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbca3b-e758-4118-8509-54e390c336d1 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:27.776279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 887/1754] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:28.134051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d6289-37f8-4d37-9368-cc00d2acc0b4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:28.137487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-069d6289-37f8-4d37-9368-cc00d2acc0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:28.161751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d6289-37f8-4d37-9368-cc00d2acc0b4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:28.195475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:28.196729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:28.197827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:28.198341 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] PATH_INFO: `/v3/users/89e75885365643fbb38fba27fe4355ce` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:28.203624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e75885365643fbb38fba27fe4355ce)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:28.206021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:28.567185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e75885365643fbb38fba27fe4355ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:28.569524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e75885365643fbb38fba27fe4355ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:28.606385 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e75885365643fbb38fba27fe4355ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:28.616994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:28.627858 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e75885365643fbb38fba27fe4355ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:28.707210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e75885365643fbb38fba27fe4355ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:28.718103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 868/1755] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:28 2022] DELETE /identity/v3/users/89e75885365643fbb38fba27fe4355ce => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:28.722195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be70e31-2108-4ae2-8527-01f38e34d77b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:28.722817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be70e31-2108-4ae2-8527-01f38e34d77b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:28.722817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be70e31-2108-4ae2-8527-01f38e34d77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:28.784735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6be70e31-2108-4ae2-8527-01f38e34d77b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:28.786023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6be70e31-2108-4ae2-8527-01f38e34d77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:28.981658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 888/1756] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:29.026793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:29.028680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:29.178227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0636e-72e0-4b96-9b3e-c87a1da3d325 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:29.189396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724dc7-8bf6-4044-82cf-a4d3024b338f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:29.197945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724dc7-8bf6-4044-82cf-a4d3024b338f service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:29.197945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724dc7-8bf6-4044-82cf-a4d3024b338f service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:29.197945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724dc7-8bf6-4044-82cf-a4d3024b338f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:29.261492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45724dc7-8bf6-4044-82cf-a4d3024b338f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:29.279934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45724dc7-8bf6-4044-82cf-a4d3024b338f service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:29.344297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 869/1757] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:30.027258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe5615-1a51-41d5-9478-7eeff6addbba None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:30.027861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe5615-1a51-41d5-9478-7eeff6addbba None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:30.027861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe5615-1a51-41d5-9478-7eeff6addbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:30.098965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-edbe5615-1a51-41d5-9478-7eeff6addbba None None] MFA Rules not processed for user `cbb22c3df9e9452db19974f52d3ebb17`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:30.105732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-edbe5615-1a51-41d5-9478-7eeff6addbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:30.362518 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 889/1758] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:31.229574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724dc7-8bf6-4044-82cf-a4d3024b338f service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:31.231865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-45724dc7-8bf6-4044-82cf-a4d3024b338f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:31.284589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724dc7-8bf6-4044-82cf-a4d3024b338f service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:31.305005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:31.306150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:31.306515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:31.307105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] PATH_INFO: `/v3/projects/ebfc24b324224839af84ca4175024caf` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:31.311933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebfc24b324224839af84ca4175024caf)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:31.319372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:31.515421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebfc24b324224839af84ca4175024caf', 'request_id': 'req-970fb453-56e5-49db-9feb-8d1440771f75'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:31.538702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebfc24b324224839af84ca4175024caf', 'request_id': 'req-970fb453-56e5-49db-9feb-8d1440771f75'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:31.713380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebfc24b324224839af84ca4175024caf', 'request_id': 'req-970fb453-56e5-49db-9feb-8d1440771f75'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:31.732969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] The token cache is being invalidate because project ebfc24b324224839af84ca4175024caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:31.733561 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:31.745575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:31.750563 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 870/1759] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:31 2022] DELETE /identity/v3/projects/ebfc24b324224839af84ca4175024caf => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:31.755404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe5615-1a51-41d5-9478-7eeff6addbba None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:31.776175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe5615-1a51-41d5-9478-7eeff6addbba None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:31.914034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:31.920894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:31.921192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:31.921466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] PATH_INFO: `/v3/users/9a2afd9d1074460a9637f0ce67385a83` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:31.923151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2afd9d1074460a9637f0ce67385a83)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:31.926600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:32.092488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:32.197625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2afd9d1074460a9637f0ce67385a83'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:32.229998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2afd9d1074460a9637f0ce67385a83'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:32.341853 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2afd9d1074460a9637f0ce67385a83'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:32.342483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2afd9d1074460a9637f0ce67385a83'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:32.395713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9065abb4-6543-4a7a-a4d5-c4d3cd2c2375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2afd9d1074460a9637f0ce67385a83'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:32.425206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 890/1760] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:31 2022] DELETE /identity/v3/users/9a2afd9d1074460a9637f0ce67385a83 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:32.883836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:32.885974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:32.919503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fb453-56e5-49db-9feb-8d1440771f75 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:33.159391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:33.160520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:33.161299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:33.162435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] PATH_INFO: `/v3/projects/962b0e13bc754488a60871dff95b1829` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:33.164993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] RBAC: Authorizing `identity:delete_project(project_id=962b0e13bc754488a60871dff95b1829)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:33.173810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:33.232681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170c01-724f-42a3-9046-419c24c6a9fb None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:33.233290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170c01-724f-42a3-9046-419c24c6a9fb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:33.233290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170c01-724f-42a3-9046-419c24c6a9fb None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:33.235209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 891/1761] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:46:33.257722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:33.316476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8a04-4303-405a-aad8-113cd07b322f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:33.316851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8a04-4303-405a-aad8-113cd07b322f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:33.317144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8a04-4303-405a-aad8-113cd07b322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:33.360133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-346a8a04-4303-405a-aad8-113cd07b322f None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:33.361378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-346a8a04-4303-405a-aad8-113cd07b322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:33.446742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962b0e13bc754488a60871dff95b1829', 'request_id': 'req-b173001a-04b4-4d8d-8b0c-1bc84e43526f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:33.488217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962b0e13bc754488a60871dff95b1829', 'request_id': 'req-b173001a-04b4-4d8d-8b0c-1bc84e43526f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:33.599332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962b0e13bc754488a60871dff95b1829', 'request_id': 'req-b173001a-04b4-4d8d-8b0c-1bc84e43526f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:33.629486 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] The token cache is being invalidate because project 962b0e13bc754488a60871dff95b1829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:33.629817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:33.632450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:33.652523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 871/1762] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:32 2022] DELETE /identity/v3/projects/962b0e13bc754488a60871dff95b1829 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:33.652523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:33.652523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:33.710871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 892/1763] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:46:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:33.966873 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173001a-04b4-4d8d-8b0c-1bc84e43526f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:33.988429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:33.989499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:34.002072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:34.003717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] PATH_INFO: `/v3/users/4a4c675062df4153b7cd4a0605a5ef03` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:34.006325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4c675062df4153b7cd4a0605a5ef03)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:34.016258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:34.304964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4c675062df4153b7cd4a0605a5ef03'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:34.307874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4c675062df4153b7cd4a0605a5ef03'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:34.356337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4c675062df4153b7cd4a0605a5ef03'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:34.375805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4c675062df4153b7cd4a0605a5ef03'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:34.461616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4c675062df4153b7cd4a0605a5ef03'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:34.473161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 872/1764] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:33 2022] DELETE /identity/v3/users/4a4c675062df4153b7cd4a0605a5ef03 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:34.538612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8a04-4303-405a-aad8-113cd07b322f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:34.541630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-346a8a04-4303-405a-aad8-113cd07b322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:34.585042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8a04-4303-405a-aad8-113cd07b322f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:34.695784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:34.698823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:34.701475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:34.701666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] PATH_INFO: `/v3/projects/b375ee63f20c4b32a30c97ed8b366a3d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:34.714881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b375ee63f20c4b32a30c97ed8b366a3d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:34.717080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:34.882753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:34.917740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b375ee63f20c4b32a30c97ed8b366a3d', 'request_id': 'req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.010266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b375ee63f20c4b32a30c97ed8b366a3d', 'request_id': 'req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.026400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b375ee63f20c4b32a30c97ed8b366a3d', 'request_id': 'req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.100549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] The token cache is being invalidate because project b375ee63f20c4b32a30c97ed8b366a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:35.100943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.107330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.111693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 893/1765] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:34 2022] DELETE /identity/v3/projects/b375ee63f20c4b32a30c97ed8b366a3d => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:35.113790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:35.115719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:35.160295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963199a-687a-4e8f-843c-7a9c9dd5f668 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:35.271637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:35.273216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:35.336940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:35.339015 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:35.339739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:35.342831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] PATH_INFO: `/v3/users/46b6ae0329dd49d4ae20d00e78119195` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:35.342831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] RBAC: Authorizing `identity:delete_user(user_id=46b6ae0329dd49d4ae20d00e78119195)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:35.346010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:35.494626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a9aa5-c606-4bdd-b7b4-6d8841a13065 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:35.494626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9642d6-468f-45be-9ac6-99dcd047e782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:35.494626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9642d6-468f-45be-9ac6-99dcd047e782 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:35.494626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9642d6-468f-45be-9ac6-99dcd047e782 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:35.495074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9642d6-468f-45be-9ac6-99dcd047e782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:35.497123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cf9642d6-468f-45be-9ac6-99dcd047e782 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:35.530502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9642d6-468f-45be-9ac6-99dcd047e782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:35.532989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9642d6-468f-45be-9ac6-99dcd047e782 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:35.562284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 894/1766] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:35.701602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46b6ae0329dd49d4ae20d00e78119195'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.707232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46b6ae0329dd49d4ae20d00e78119195'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.741638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46b6ae0329dd49d4ae20d00e78119195'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.755487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46b6ae0329dd49d4ae20d00e78119195'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.861548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46b6ae0329dd49d4ae20d00e78119195'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:35.892048 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 873/1767] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:35 2022] DELETE /identity/v3/users/46b6ae0329dd49d4ae20d00e78119195 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:36.031713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:36.148269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462b282-52c7-4571-ae4c-e8ec9b2063fe None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:36.148641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462b282-52c7-4571-ae4c-e8ec9b2063fe None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:36.149589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462b282-52c7-4571-ae4c-e8ec9b2063fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:36.187111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e462b282-52c7-4571-ae4c-e8ec9b2063fe None None] MFA Rules not processed for user `38331c36830a426cbc41b370c707e44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:36.188722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e462b282-52c7-4571-ae4c-e8ec9b2063fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:36.341832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 895/1768] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:36.492958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:36.495392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:36.731918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f7ae9-1e68-4bf5-8d30-080ab070175e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:36.741582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:36.747416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:36.747416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:36.747416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] PATH_INFO: `/v3/projects/d0f1c1247bf8425ebdb7c228f04ed264` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:36.747416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f1c1247bf8425ebdb7c228f04ed264)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:36.764586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:37.227564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f1c1247bf8425ebdb7c228f04ed264', 'request_id': 'req-672a5f1f-1e3d-4fc9-9641-2efe8115766b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.240599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462b282-52c7-4571-ae4c-e8ec9b2063fe None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:37.241110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f1c1247bf8425ebdb7c228f04ed264', 'request_id': 'req-672a5f1f-1e3d-4fc9-9641-2efe8115766b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.241211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e462b282-52c7-4571-ae4c-e8ec9b2063fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:37.259350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462b282-52c7-4571-ae4c-e8ec9b2063fe None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:37.312021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f1c1247bf8425ebdb7c228f04ed264', 'request_id': 'req-672a5f1f-1e3d-4fc9-9641-2efe8115766b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.358453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:37.358810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] The token cache is being invalidate because project d0f1c1247bf8425ebdb7c228f04ed264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:37.359166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.361104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.361719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-672a5f1f-1e3d-4fc9-9641-2efe8115766b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.362312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.362595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] PATH_INFO: `/v3/projects/9d885a6540bf41abade4c61d78669a31` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.366573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 874/1769] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:36 2022] DELETE /identity/v3/projects/d0f1c1247bf8425ebdb7c228f04ed264 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:37.369788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d885a6540bf41abade4c61d78669a31)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:37.371322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7efce-2fce-42fd-8933-70bbebbaac29 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.371617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7efce-2fce-42fd-8933-70bbebbaac29 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.371909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7efce-2fce-42fd-8933-70bbebbaac29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.373636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:37.406522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fde7efce-2fce-42fd-8933-70bbebbaac29 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:37.407814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fde7efce-2fce-42fd-8933-70bbebbaac29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:37.420017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 875/1770] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:37.430361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237886d1-b21f-4278-8636-8ebea183ab14 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.430900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237886d1-b21f-4278-8636-8ebea183ab14 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.432245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237886d1-b21f-4278-8636-8ebea183ab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.455029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-237886d1-b21f-4278-8636-8ebea183ab14 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:37.456338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-237886d1-b21f-4278-8636-8ebea183ab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:37.466740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 876/1771] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:37.471792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237886d1-b21f-4278-8636-8ebea183ab14 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:37.482611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237886d1-b21f-4278-8636-8ebea183ab14 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:37.489295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979624-71c0-4b82-b923-167e610d2ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:37.494632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979624-71c0-4b82-b923-167e610d2ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.494632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979624-71c0-4b82-b923-167e610d2ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.494632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979624-71c0-4b82-b923-167e610d2ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.494632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d979624-71c0-4b82-b923-167e610d2ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:46:37.494632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d979624-71c0-4b82-b923-167e610d2ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:37.494632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d979624-71c0-4b82-b923-167e610d2ddf admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:37.508743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 877/1772] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:46:37.514346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979624-71c0-4b82-b923-167e610d2ddf admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:37.531096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979624-71c0-4b82-b923-167e610d2ddf admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:37.548853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2b2db-aae0-4a63-aa58-0f1ece2aecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:37.557402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2b2db-aae0-4a63-aa58-0f1ece2aecd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.557402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2b2db-aae0-4a63-aa58-0f1ece2aecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.557402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2b2db-aae0-4a63-aa58-0f1ece2aecd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.557402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2b2db-aae0-4a63-aa58-0f1ece2aecd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:37.557402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2b2db-aae0-4a63-aa58-0f1ece2aecd2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:37.560364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d885a6540bf41abade4c61d78669a31', 'request_id': 'req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.666367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d885a6540bf41abade4c61d78669a31', 'request_id': 'req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.676277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 878/1773] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:37 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:46:37.680271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2b2db-aae0-4a63-aa58-0f1ece2aecd2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:37.683170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d885a6540bf41abade4c61d78669a31', 'request_id': 'req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.711921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] The token cache is being invalidate because project 9d885a6540bf41abade4c61d78669a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:37.714977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.714977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a8cc75a1-8473-4177-aa0c-a1a7f9001b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:37.721506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 896/1774] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:37 2022] DELETE /identity/v3/projects/9d885a6540bf41abade4c61d78669a31 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:37.721930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756a60c-ac4e-4403-bd2c-b273512b952f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.722228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756a60c-ac4e-4403-bd2c-b273512b952f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.722512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756a60c-ac4e-4403-bd2c-b273512b952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.753092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8756a60c-ac4e-4403-bd2c-b273512b952f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:37.756405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8756a60c-ac4e-4403-bd2c-b273512b952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:37.793298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2b2db-aae0-4a63-aa58-0f1ece2aecd2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:37.801955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af99892-1ea1-473a-a4e3-04e45465ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:37.803473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af99892-1ea1-473a-a4e3-04e45465ebfa admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.804144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af99892-1ea1-473a-a4e3-04e45465ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.804705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af99892-1ea1-473a-a4e3-04e45465ebfa admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.805575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af99892-1ea1-473a-a4e3-04e45465ebfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:37.809642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af99892-1ea1-473a-a4e3-04e45465ebfa admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:37.844860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:37.854831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 897/1775] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:37.857642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc10c-17a3-40e9-af23-66598e5d67ef None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.857941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc10c-17a3-40e9-af23-66598e5d67ef None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.858658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cffc10c-17a3-40e9-af23-66598e5d67ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.878776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3cffc10c-17a3-40e9-af23-66598e5d67ef None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:37.887073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3cffc10c-17a3-40e9-af23-66598e5d67ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:37.892168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 898/1776] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:37.893292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc10c-17a3-40e9-af23-66598e5d67ef None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:37.904926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cffc10c-17a3-40e9-af23-66598e5d67ef None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:37.909973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b405bd-8db7-4e81-8227-352c4b812974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:37.910704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b405bd-8db7-4e81-8227-352c4b812974 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.911034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b405bd-8db7-4e81-8227-352c4b812974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.911472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b405bd-8db7-4e81-8227-352c4b812974 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.912488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b405bd-8db7-4e81-8227-352c4b812974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:46:37.912770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b405bd-8db7-4e81-8227-352c4b812974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:37.914679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b405bd-8db7-4e81-8227-352c4b812974 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:37.942091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 899/1777] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:46:37.943408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b405bd-8db7-4e81-8227-352c4b812974 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:37.950869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 879/1778] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:37 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:37.953721 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af99892-1ea1-473a-a4e3-04e45465ebfa admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:37.955607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2af99892-1ea1-473a-a4e3-04e45465ebfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:37.956066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b405bd-8db7-4e81-8227-352c4b812974 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:37.964605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2e721-f387-4be3-8626-7e80800d5908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:37.965296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2e721-f387-4be3-8626-7e80800d5908 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.966086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2e721-f387-4be3-8626-7e80800d5908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.966086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a2e721-f387-4be3-8626-7e80800d5908 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.966540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2e721-f387-4be3-8626-7e80800d5908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:37.969015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a2e721-f387-4be3-8626-7e80800d5908 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:37.970027 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af99892-1ea1-473a-a4e3-04e45465ebfa admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:37.975966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb3c6-9d3f-4f87-919e-56f736231051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:37.983247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb3c6-9d3f-4f87-919e-56f736231051 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:37.983247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb3c6-9d3f-4f87-919e-56f736231051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:37.983247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb3c6-9d3f-4f87-919e-56f736231051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:37.983247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cb3c6-9d3f-4f87-919e-56f736231051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:37.984297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cb3c6-9d3f-4f87-919e-56f736231051 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:37.998319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 880/1779] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:37.999495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb3c6-9d3f-4f87-919e-56f736231051 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.012173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb3c6-9d3f-4f87-919e-56f736231051 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:38.017115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e9746-3b1d-4ae2-a363-93d7f3e75abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:38.017791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e9746-3b1d-4ae2-a363-93d7f3e75abc admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.018078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e9746-3b1d-4ae2-a363-93d7f3e75abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.018398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e9746-3b1d-4ae2-a363-93d7f3e75abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.019161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e9746-3b1d-4ae2-a363-93d7f3e75abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:38.020827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e9746-3b1d-4ae2-a363-93d7f3e75abc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:38.033295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 881/1780] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:38.037527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e9746-3b1d-4ae2-a363-93d7f3e75abc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.047859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e9746-3b1d-4ae2-a363-93d7f3e75abc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:38.052769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0006e1-20aa-4f76-90f6-d5e4f02cea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:38.058524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0006e1-20aa-4f76-90f6-d5e4f02cea07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.058524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0006e1-20aa-4f76-90f6-d5e4f02cea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.058524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0006e1-20aa-4f76-90f6-d5e4f02cea07 admin admin] PATH_INFO: `/v3/projects/1b6847e51ccf4f44b8164b15fed4ba35/users/51f8235f4c084b16ab61dc826b32d6da/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.071067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0006e1-20aa-4f76-90f6-d5e4f02cea07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6847e51ccf4f44b8164b15fed4ba35, user_id=51f8235f4c084b16ab61dc826b32d6da, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:38.074034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0006e1-20aa-4f76-90f6-d5e4f02cea07 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:38.090880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 900/1781] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:37 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:38.093134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2e721-f387-4be3-8626-7e80800d5908 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.206007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a2e721-f387-4be3-8626-7e80800d5908 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:38.217160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 882/1782] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:38 2022] PUT /identity/v3/projects/1b6847e51ccf4f44b8164b15fed4ba35/users/51f8235f4c084b16ab61dc826b32d6da/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:38.218188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f506f-3146-48bc-bee5-cc2d2a0e678c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.218505 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f506f-3146-48bc-bee5-cc2d2a0e678c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.218926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f506f-3146-48bc-bee5-cc2d2a0e678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.285205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a86f506f-3146-48bc-bee5-cc2d2a0e678c None None] MFA Rules not processed for user `51f8235f4c084b16ab61dc826b32d6da`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:38.288147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a86f506f-3146-48bc-bee5-cc2d2a0e678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:38.348049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad27f3-28ac-4e35-a056-86f1fc4f78c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:38.349528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad27f3-28ac-4e35-a056-86f1fc4f78c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.350055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad27f3-28ac-4e35-a056-86f1fc4f78c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.350489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad27f3-28ac-4e35-a056-86f1fc4f78c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.351855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad27f3-28ac-4e35-a056-86f1fc4f78c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:38.356625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad27f3-28ac-4e35-a056-86f1fc4f78c5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:38.458393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 883/1783] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:38.476960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f506f-3146-48bc-bee5-cc2d2a0e678c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.482427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f506f-3146-48bc-bee5-cc2d2a0e678c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:38.487415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513f73b-5d46-448a-a1fa-2d8348a2e79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:38.488228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513f73b-5d46-448a-a1fa-2d8348a2e79a admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.488517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513f73b-5d46-448a-a1fa-2d8348a2e79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.488789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513f73b-5d46-448a-a1fa-2d8348a2e79a admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.489574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513f73b-5d46-448a-a1fa-2d8348a2e79a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:38.491415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513f73b-5d46-448a-a1fa-2d8348a2e79a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:38.504020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 901/1784] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:38 2022] POST /identity/v3/users => generated 291 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:38.508105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad27f3-28ac-4e35-a056-86f1fc4f78c5 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.520666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad27f3-28ac-4e35-a056-86f1fc4f78c5 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:38.523462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741c6e3-5cc9-41d5-806d-d69e8313f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:38.524128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741c6e3-5cc9-41d5-806d-d69e8313f3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.524417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741c6e3-5cc9-41d5-806d-d69e8313f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.524694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741c6e3-5cc9-41d5-806d-d69e8313f3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.525457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741c6e3-5cc9-41d5-806d-d69e8313f3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:38.527150 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741c6e3-5cc9-41d5-806d-d69e8313f3dd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:38.537828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 902/1785] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:38.543891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741c6e3-5cc9-41d5-806d-d69e8313f3dd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.557144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741c6e3-5cc9-41d5-806d-d69e8313f3dd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:38.566530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237327c-5de9-4bf2-a9e3-efe90357640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:38.567200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237327c-5de9-4bf2-a9e3-efe90357640c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.572734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237327c-5de9-4bf2-a9e3-efe90357640c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.572734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237327c-5de9-4bf2-a9e3-efe90357640c admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.572734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237327c-5de9-4bf2-a9e3-efe90357640c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:38.572734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237327c-5de9-4bf2-a9e3-efe90357640c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:38.584976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 903/1786] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:38.594513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237327c-5de9-4bf2-a9e3-efe90357640c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.605486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237327c-5de9-4bf2-a9e3-efe90357640c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:38.611324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce70bc6-51ca-4d22-84ba-449e02241ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:38.612236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce70bc6-51ca-4d22-84ba-449e02241ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.612502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce70bc6-51ca-4d22-84ba-449e02241ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.612773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce70bc6-51ca-4d22-84ba-449e02241ded admin admin] PATH_INFO: `/v3/projects/edf6bae9879642fe88d7297d3cb4eb1a/users/8d4cc8a88af143ad9112623659c8dccc/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.628954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce70bc6-51ca-4d22-84ba-449e02241ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=edf6bae9879642fe88d7297d3cb4eb1a, user_id=8d4cc8a88af143ad9112623659c8dccc, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:38.631622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce70bc6-51ca-4d22-84ba-449e02241ded admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:38.658251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 884/1787] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:38 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:38.659347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513f73b-5d46-448a-a1fa-2d8348a2e79a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.731994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513f73b-5d46-448a-a1fa-2d8348a2e79a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:38.739125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 904/1788] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:38 2022] PUT /identity/v3/projects/edf6bae9879642fe88d7297d3cb4eb1a/users/8d4cc8a88af143ad9112623659c8dccc/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:38.747875 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c4f15-f95c-439b-9c16-e8083a92eea7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.748432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c4f15-f95c-439b-9c16-e8083a92eea7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.749096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c4f15-f95c-439b-9c16-e8083a92eea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.780942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f97c4f15-f95c-439b-9c16-e8083a92eea7 None None] MFA Rules not processed for user `8d4cc8a88af143ad9112623659c8dccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:38.783922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f97c4f15-f95c-439b-9c16-e8083a92eea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:38.800591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c077eb6-112b-4d30-b740-b4bd7db524b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:38.801294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077eb6-112b-4d30-b740-b4bd7db524b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.801597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077eb6-112b-4d30-b740-b4bd7db524b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.801876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c077eb6-112b-4d30-b740-b4bd7db524b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.802601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c077eb6-112b-4d30-b740-b4bd7db524b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:38.804642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c077eb6-112b-4d30-b740-b4bd7db524b9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:38.889411 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:38.893272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 885/1789] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:38 2022] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:46:38.897153 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c077eb6-112b-4d30-b740-b4bd7db524b9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.924937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c077eb6-112b-4d30-b740-b4bd7db524b9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:38.947718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec4c8d-3fa8-4ff4-bd74-a7c8638620df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:38.948219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec4c8d-3fa8-4ff4-bd74-a7c8638620df admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:38.948705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec4c8d-3fa8-4ff4-bd74-a7c8638620df admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:38.948855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec4c8d-3fa8-4ff4-bd74-a7c8638620df admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:38.949744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 905/1790] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:38.953191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec4c8d-3fa8-4ff4-bd74-a7c8638620df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:38.956532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec4c8d-3fa8-4ff4-bd74-a7c8638620df admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:38.959144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c4f15-f95c-439b-9c16-e8083a92eea7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:38.978834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 886/1791] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:38.982686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec4c8d-3fa8-4ff4-bd74-a7c8638620df admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:39.002715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec4c8d-3fa8-4ff4-bd74-a7c8638620df admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:39.015577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ac45-2fdc-4adc-9421-6c6b98de2627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:39.016757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ac45-2fdc-4adc-9421-6c6b98de2627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:39.017102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ac45-2fdc-4adc-9421-6c6b98de2627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:39.017464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ac45-2fdc-4adc-9421-6c6b98de2627 admin admin] PATH_INFO: `/v3/projects/159b624b961f4d7fb5f16901c7ccaae7/users/9b37fe9b619c444d8dbcb4ce3e66d520/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:39.020911 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c4f15-f95c-439b-9c16-e8083a92eea7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:39.052220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1b7bc-3533-48c1-bdd6-27bbf50c064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:39.056983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1b7bc-3533-48c1-bdd6-27bbf50c064d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:39.058905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138ac45-2fdc-4adc-9421-6c6b98de2627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=159b624b961f4d7fb5f16901c7ccaae7, user_id=9b37fe9b619c444d8dbcb4ce3e66d520, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:39.062876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1b7bc-3533-48c1-bdd6-27bbf50c064d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:39.065354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138ac45-2fdc-4adc-9421-6c6b98de2627 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:39.066802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1b7bc-3533-48c1-bdd6-27bbf50c064d admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:39.071786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1b7bc-3533-48c1-bdd6-27bbf50c064d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:39.080376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1b7bc-3533-48c1-bdd6-27bbf50c064d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:39.228959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 906/1792] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:38 2022] POST /identity/v3/projects => generated 381 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:39.230592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 887/1793] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:38 2022] PUT /identity/v3/projects/159b624b961f4d7fb5f16901c7ccaae7/users/9b37fe9b619c444d8dbcb4ce3e66d520/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:39.234944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1b7bc-3533-48c1-bdd6-27bbf50c064d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:39.235198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ac45-2fdc-4adc-9421-6c6b98de2627 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:39.368108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1b7bc-3533-48c1-bdd6-27bbf50c064d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:39.375356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83117d-9f5e-46e7-b68f-421e445109c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:39.376044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83117d-9f5e-46e7-b68f-421e445109c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:39.376333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83117d-9f5e-46e7-b68f-421e445109c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:39.376615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83117d-9f5e-46e7-b68f-421e445109c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:39.377586 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83117d-9f5e-46e7-b68f-421e445109c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:39.382139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83117d-9f5e-46e7-b68f-421e445109c2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:39.388126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ac45-2fdc-4adc-9421-6c6b98de2627 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:39.402112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db234e-94d5-40db-af25-246a540f1200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:39.403057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db234e-94d5-40db-af25-246a540f1200 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:39.403416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db234e-94d5-40db-af25-246a540f1200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:39.403702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db234e-94d5-40db-af25-246a540f1200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:39.404447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db234e-94d5-40db-af25-246a540f1200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:39.406188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db234e-94d5-40db-af25-246a540f1200 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:39.426208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 888/1794] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:39.426208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db234e-94d5-40db-af25-246a540f1200 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:39.437658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db234e-94d5-40db-af25-246a540f1200 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:39.445080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57338e4-1ba9-4ac9-9a1c-c27b20b8968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:39.446160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57338e4-1ba9-4ac9-9a1c-c27b20b8968b admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:39.446753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57338e4-1ba9-4ac9-9a1c-c27b20b8968b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:39.447760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57338e4-1ba9-4ac9-9a1c-c27b20b8968b admin admin] PATH_INFO: `/v3/projects/159b624b961f4d7fb5f16901c7ccaae7/users/9b37fe9b619c444d8dbcb4ce3e66d520/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:39.452794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57338e4-1ba9-4ac9-9a1c-c27b20b8968b admin admin] RBAC: Authorizing `identity:create_grant(project_id=159b624b961f4d7fb5f16901c7ccaae7, user_id=9b37fe9b619c444d8dbcb4ce3e66d520, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:39.454349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57338e4-1ba9-4ac9-9a1c-c27b20b8968b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:39.470592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 889/1795] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:39 2022] PUT /identity/v3/projects/159b624b961f4d7fb5f16901c7ccaae7/users/9b37fe9b619c444d8dbcb4ce3e66d520/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:39.482323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756784-af6a-40b1-9eef-43932b203283 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:39.483224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756784-af6a-40b1-9eef-43932b203283 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:39.483522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84756784-af6a-40b1-9eef-43932b203283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:39.517235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 907/1796] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:39 2022] POST /identity/v3/users => generated 297 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:39.518724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83117d-9f5e-46e7-b68f-421e445109c2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:39.536689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83117d-9f5e-46e7-b68f-421e445109c2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:39.558003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-84756784-af6a-40b1-9eef-43932b203283 None None] MFA Rules not processed for user `9b37fe9b619c444d8dbcb4ce3e66d520`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:39.562514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-84756784-af6a-40b1-9eef-43932b203283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:39.640459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc1a64-d12e-4cad-9325-7f470c5ac68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:39.646715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc1a64-d12e-4cad-9325-7f470c5ac68b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:39.646715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc1a64-d12e-4cad-9325-7f470c5ac68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:39.646715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc1a64-d12e-4cad-9325-7f470c5ac68b admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:39.646715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc1a64-d12e-4cad-9325-7f470c5ac68b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:39.646715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc1a64-d12e-4cad-9325-7f470c5ac68b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:39.675058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 908/1797] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:39.681936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc1a64-d12e-4cad-9325-7f470c5ac68b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:39.691296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 890/1798] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:39.698837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc1a64-d12e-4cad-9325-7f470c5ac68b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:39.703629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c73c46-6cfa-4f2e-bb7b-81858a1ffdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:39.704227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c73c46-6cfa-4f2e-bb7b-81858a1ffdbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:39.705431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c73c46-6cfa-4f2e-bb7b-81858a1ffdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:39.705431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c73c46-6cfa-4f2e-bb7b-81858a1ffdbc admin admin] PATH_INFO: `/v3/projects/ff7e5e2c1e764242b12a352fa7c3039a/users/e60c98c3c2fb434fa7e80b68c84d5853/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:39.720204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84756784-af6a-40b1-9eef-43932b203283 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:39.726293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-84756784-af6a-40b1-9eef-43932b203283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:39.726408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c73c46-6cfa-4f2e-bb7b-81858a1ffdbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7e5e2c1e764242b12a352fa7c3039a, user_id=e60c98c3c2fb434fa7e80b68c84d5853, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:39.728852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c73c46-6cfa-4f2e-bb7b-81858a1ffdbc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:39.822777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84756784-af6a-40b1-9eef-43932b203283 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:39.830098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c86df-ab2f-4caa-ab62-816117889a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:39.834747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c86df-ab2f-4caa-ab62-816117889a89 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:39.834747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c86df-ab2f-4caa-ab62-816117889a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:39.834747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c86df-ab2f-4caa-ab62-816117889a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:39.850802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c86df-ab2f-4caa-ab62-816117889a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:39.856748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:39.864061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77c86df-ab2f-4caa-ab62-816117889a89 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:39.868058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 909/1799] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:39 2022] PUT /identity/v3/projects/ff7e5e2c1e764242b12a352fa7c3039a/users/e60c98c3c2fb434fa7e80b68c84d5853/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:39.873331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c73c46-6cfa-4f2e-bb7b-81858a1ffdbc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:39.882895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 891/1800] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:39.991497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c86df-ab2f-4caa-ab62-816117889a89 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:40.006661 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c86df-ab2f-4caa-ab62-816117889a89 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:40.086057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c73c46-6cfa-4f2e-bb7b-81858a1ffdbc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:40.095218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee8d42-b2d2-4e7f-a732-46e3924802d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:40.096221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee8d42-b2d2-4e7f-a732-46e3924802d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:40.096507 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee8d42-b2d2-4e7f-a732-46e3924802d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:40.097529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee8d42-b2d2-4e7f-a732-46e3924802d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:40.098183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee8d42-b2d2-4e7f-a732-46e3924802d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:40.110490 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee8d42-b2d2-4e7f-a732-46e3924802d6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:40.110670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:40.110670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:40.110670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:40.110670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] PATH_INFO: `/v3/users/51f8235f4c084b16ab61dc826b32d6da` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:40.122099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f8235f4c084b16ab61dc826b32d6da)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:40.122099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:40.132283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 910/1801] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:40.139405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee8d42-b2d2-4e7f-a732-46e3924802d6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:40.156973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee8d42-b2d2-4e7f-a732-46e3924802d6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:40.162728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c7f8-bbd5-4651-8287-dc7b32d888c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:40.163775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c7f8-bbd5-4651-8287-dc7b32d888c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:40.164104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c7f8-bbd5-4651-8287-dc7b32d888c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:40.164425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c7f8-bbd5-4651-8287-dc7b32d888c8 admin admin] PATH_INFO: `/v3/projects/ff7e5e2c1e764242b12a352fa7c3039a/users/e60c98c3c2fb434fa7e80b68c84d5853/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:40.167872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c7f8-bbd5-4651-8287-dc7b32d888c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7e5e2c1e764242b12a352fa7c3039a, user_id=e60c98c3c2fb434fa7e80b68c84d5853, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:40.170951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c7f8-bbd5-4651-8287-dc7b32d888c8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:40.183241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 911/1802] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:40 2022] PUT /identity/v3/projects/ff7e5e2c1e764242b12a352fa7c3039a/users/e60c98c3c2fb434fa7e80b68c84d5853/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:40.194414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf755c6-f194-4850-82cc-e61a3b074fb8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:40.195369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf755c6-f194-4850-82cc-e61a3b074fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:40.195809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf755c6-f194-4850-82cc-e61a3b074fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:40.238217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bdf755c6-f194-4850-82cc-e61a3b074fb8 None None] MFA Rules not processed for user `e60c98c3c2fb434fa7e80b68c84d5853`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:40.239488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bdf755c6-f194-4850-82cc-e61a3b074fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:40.322963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f8235f4c084b16ab61dc826b32d6da'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:40.324148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f8235f4c084b16ab61dc826b32d6da'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:40.345687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f8235f4c084b16ab61dc826b32d6da'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:40.362913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f8235f4c084b16ab61dc826b32d6da'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:40.365789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 912/1803] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:40.378945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf755c6-f194-4850-82cc-e61a3b074fb8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:40.380593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bdf755c6-f194-4850-82cc-e61a3b074fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:40.437888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf755c6-f194-4850-82cc-e61a3b074fb8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:40.441491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962debc8-7a45-4946-88db-ff7289a1c13e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:40.442139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962debc8-7a45-4946-88db-ff7289a1c13e service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:40.442427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962debc8-7a45-4946-88db-ff7289a1c13e service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:40.442703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962debc8-7a45-4946-88db-ff7289a1c13e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:40.452614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962debc8-7a45-4946-88db-ff7289a1c13e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:40.455275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962debc8-7a45-4946-88db-ff7289a1c13e service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:40.464309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 913/1804] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:46:40.479277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f8235f4c084b16ab61dc826b32d6da'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:40.494077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 892/1805] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:39 2022] DELETE /identity/v3/users/51f8235f4c084b16ab61dc826b32d6da => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:40.499108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261efa4-297a-4dc5-b703-9ea7fa6fa5a2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:40.499402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261efa4-297a-4dc5-b703-9ea7fa6fa5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:40.499686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e261efa4-297a-4dc5-b703-9ea7fa6fa5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:40.535809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e261efa4-297a-4dc5-b703-9ea7fa6fa5a2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:40.537253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e261efa4-297a-4dc5-b703-9ea7fa6fa5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:40.648684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 914/1806] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:40.690471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:40.734181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:40.736359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:40.908143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872ee1f-53e9-48ca-af2c-c3232b75871c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:40.915113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40369695-2762-4c77-86ac-b25360d992bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:40.915827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40369695-2762-4c77-86ac-b25360d992bc service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:40.916693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40369695-2762-4c77-86ac-b25360d992bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:40.916981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40369695-2762-4c77-86ac-b25360d992bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:40.932035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40369695-2762-4c77-86ac-b25360d992bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:40.933773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40369695-2762-4c77-86ac-b25360d992bc service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:40.953970 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 893/1807] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:41.366557 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261efa4-297a-4dc5-b703-9ea7fa6fa5a2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:41.368046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e261efa4-297a-4dc5-b703-9ea7fa6fa5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:41.384413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e261efa4-297a-4dc5-b703-9ea7fa6fa5a2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:41.393388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:41.395332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:41.395635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:41.397698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] PATH_INFO: `/v3/users/8d4cc8a88af143ad9112623659c8dccc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:41.399868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4cc8a88af143ad9112623659c8dccc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:41.402699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:41.537115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:41.604949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4cc8a88af143ad9112623659c8dccc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:41.633432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4cc8a88af143ad9112623659c8dccc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:41.713287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4cc8a88af143ad9112623659c8dccc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:41.714034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4cc8a88af143ad9112623659c8dccc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:41.721686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4cc8a88af143ad9112623659c8dccc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:41.742048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 915/1808] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:41 2022] DELETE /identity/v3/users/8d4cc8a88af143ad9112623659c8dccc => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:41.747294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cd1ec-ab6d-4b9a-a15d-16f65040b6da None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:41.748111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cd1ec-ab6d-4b9a-a15d-16f65040b6da None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:41.748552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0cd1ec-ab6d-4b9a-a15d-16f65040b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:41.768302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3c0cd1ec-ab6d-4b9a-a15d-16f65040b6da None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:41.769829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3c0cd1ec-ab6d-4b9a-a15d-16f65040b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:41.867965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 894/1809] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:41.885538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:41.887327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:42.009044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6a7c6-0801-4ab4-b130-f9a1185bb25e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:42.013664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27861468-cb31-4af2-885c-571afb3f1963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:42.013832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27861468-cb31-4af2-885c-571afb3f1963 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:42.014081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27861468-cb31-4af2-885c-571afb3f1963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:42.014479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27861468-cb31-4af2-885c-571afb3f1963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:42.030959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27861468-cb31-4af2-885c-571afb3f1963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:42.032476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27861468-cb31-4af2-885c-571afb3f1963 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:42.045410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 916/1810] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:42.926890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cd1ec-ab6d-4b9a-a15d-16f65040b6da None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:42.929869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3c0cd1ec-ab6d-4b9a-a15d-16f65040b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:42.948958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0cd1ec-ab6d-4b9a-a15d-16f65040b6da None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:42.955806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:42.957410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:42.958323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:42.958323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] PATH_INFO: `/v3/projects/1b6847e51ccf4f44b8164b15fed4ba35` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:42.961611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6847e51ccf4f44b8164b15fed4ba35)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:42.964369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:43.037466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:43.157125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6847e51ccf4f44b8164b15fed4ba35', 'request_id': 'req-a512551d-7ca9-4fb6-b8e7-9e321327e795'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.164968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6847e51ccf4f44b8164b15fed4ba35', 'request_id': 'req-a512551d-7ca9-4fb6-b8e7-9e321327e795'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.294566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6847e51ccf4f44b8164b15fed4ba35', 'request_id': 'req-a512551d-7ca9-4fb6-b8e7-9e321327e795'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.324569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] The token cache is being invalidate because project 1b6847e51ccf4f44b8164b15fed4ba35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:43.324833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.326452 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a512551d-7ca9-4fb6-b8e7-9e321327e795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.331777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 895/1811] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:42 2022] DELETE /identity/v3/projects/1b6847e51ccf4f44b8164b15fed4ba35 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:43.333807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27861468-cb31-4af2-885c-571afb3f1963 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:43.347084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27861468-cb31-4af2-885c-571afb3f1963 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:43.460147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:43.470075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:43.470075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:43.470075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] PATH_INFO: `/v3/users/9b37fe9b619c444d8dbcb4ce3e66d520` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:43.470075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b37fe9b619c444d8dbcb4ce3e66d520)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:43.471982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:43.725088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b37fe9b619c444d8dbcb4ce3e66d520'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.739582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b37fe9b619c444d8dbcb4ce3e66d520'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.787561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b37fe9b619c444d8dbcb4ce3e66d520'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.788463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b37fe9b619c444d8dbcb4ce3e66d520'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.796832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b853ab89-c17c-4a6a-b6b2-2ca4b238af57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b37fe9b619c444d8dbcb4ce3e66d520'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:43.810167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 917/1812] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:43 2022] DELETE /identity/v3/users/9b37fe9b619c444d8dbcb4ce3e66d520 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:43.896204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:44.126891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4b79-56d8-4ef7-829c-5214efc50b94 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:44.127378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4b79-56d8-4ef7-829c-5214efc50b94 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:44.127378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c4b79-56d8-4ef7-829c-5214efc50b94 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:44.128776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 896/1813] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:46:44.144963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0b41-e606-47b5-b799-cd8ee453edc2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:44.145261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0b41-e606-47b5-b799-cd8ee453edc2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:44.145624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f0b41-e606-47b5-b799-cd8ee453edc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:44.182465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-390f0b41-e606-47b5-b799-cd8ee453edc2 None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:44.183900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-390f0b41-e606-47b5-b799-cd8ee453edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:44.316862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4b79-56d8-4ef7-829c-5214efc50b94 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:44.318871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-661c4b79-56d8-4ef7-829c-5214efc50b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:44.353717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 918/1814] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:46:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:44.437920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0b41-e606-47b5-b799-cd8ee453edc2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:44.440545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-390f0b41-e606-47b5-b799-cd8ee453edc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:44.470331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f0b41-e606-47b5-b799-cd8ee453edc2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:44.477410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d109f8-71db-4a7f-8a96-725f1117d8d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:44.478376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d109f8-71db-4a7f-8a96-725f1117d8d7 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:44.479134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d109f8-71db-4a7f-8a96-725f1117d8d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:44.479557 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d109f8-71db-4a7f-8a96-725f1117d8d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:44.486729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c4b79-56d8-4ef7-829c-5214efc50b94 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:44.498012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:44.499993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:44.502440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d109f8-71db-4a7f-8a96-725f1117d8d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:44.504904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:44.505426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] PATH_INFO: `/v3/projects/edf6bae9879642fe88d7297d3cb4eb1a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:44.515997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d109f8-71db-4a7f-8a96-725f1117d8d7 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:44.518206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=edf6bae9879642fe88d7297d3cb4eb1a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:44.521408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:44.534680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 919/1815] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:46:44.601886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d109f8-71db-4a7f-8a96-725f1117d8d7 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:44.605197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-21d109f8-71db-4a7f-8a96-725f1117d8d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:44.632247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d109f8-71db-4a7f-8a96-725f1117d8d7 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:44.640691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edf6bae9879642fe88d7297d3cb4eb1a', 'request_id': 'req-4fbad6ea-3592-4945-ab97-03def2bba29b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:44.648554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edf6bae9879642fe88d7297d3cb4eb1a', 'request_id': 'req-4fbad6ea-3592-4945-ab97-03def2bba29b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:44.720827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:44.722324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:44.722751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:44.723495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] PATH_INFO: `/v3/projects/159b624b961f4d7fb5f16901c7ccaae7` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:44.724858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=159b624b961f4d7fb5f16901c7ccaae7)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:44.727224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:44.736490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edf6bae9879642fe88d7297d3cb4eb1a', 'request_id': 'req-4fbad6ea-3592-4945-ab97-03def2bba29b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:44.769744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] The token cache is being invalidate because project edf6bae9879642fe88d7297d3cb4eb1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:44.771101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:44.778623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:44.781689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 897/1816] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:44 2022] DELETE /identity/v3/projects/edf6bae9879642fe88d7297d3cb4eb1a => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:44.785655 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:44.787348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:44.802088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbad6ea-3592-4945-ab97-03def2bba29b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:44.809764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:44.810971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:44.811516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:44.812089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] PATH_INFO: `/v3/users/e60c98c3c2fb434fa7e80b68c84d5853` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:44.813695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60c98c3c2fb434fa7e80b68c84d5853)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:44.815868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:44.883596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:44.886246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159b624b961f4d7fb5f16901c7ccaae7', 'request_id': 'req-686fc82f-d2c7-4086-9748-bd9193709e9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:44.993499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159b624b961f4d7fb5f16901c7ccaae7', 'request_id': 'req-686fc82f-d2c7-4086-9748-bd9193709e9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:45.007337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159b624b961f4d7fb5f16901c7ccaae7', 'request_id': 'req-686fc82f-d2c7-4086-9748-bd9193709e9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:45.044140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60c98c3c2fb434fa7e80b68c84d5853'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:45.045697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60c98c3c2fb434fa7e80b68c84d5853'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:45.057427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] The token cache is being invalidate because project 159b624b961f4d7fb5f16901c7ccaae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:45.058832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:45.060202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-686fc82f-d2c7-4086-9748-bd9193709e9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:45.066270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 920/1817] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:44 2022] DELETE /identity/v3/projects/159b624b961f4d7fb5f16901c7ccaae7 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:45.071701 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bcec1-3fe1-4734-8dd2-241f4884a097 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:45.072958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60c98c3c2fb434fa7e80b68c84d5853'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:45.073275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bcec1-3fe1-4734-8dd2-241f4884a097 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:45.073585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bcec1-3fe1-4734-8dd2-241f4884a097 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:45.077443 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 921/1818] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:46:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:46:45.079794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c208-7d1e-4241-9653-9e9965090c05 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:45.081616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60c98c3c2fb434fa7e80b68c84d5853'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:45.084570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c208-7d1e-4241-9653-9e9965090c05 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:45.084878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53c208-7d1e-4241-9653-9e9965090c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:45.129955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2b53c208-7d1e-4241-9653-9e9965090c05 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:45.131483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2b53c208-7d1e-4241-9653-9e9965090c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:45.171550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-13bca4cb-9b4f-4479-8d59-53566d7fa7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60c98c3c2fb434fa7e80b68c84d5853'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:45.182268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 898/1819] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:44 2022] DELETE /identity/v3/users/e60c98c3c2fb434fa7e80b68c84d5853 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:45.184063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4f65-fb95-4f7d-9326-7254cd2b00a3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:45.186873 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4f65-fb95-4f7d-9326-7254cd2b00a3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:45.187416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c4f65-fb95-4f7d-9326-7254cd2b00a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:45.230359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-268c4f65-fb95-4f7d-9326-7254cd2b00a3 None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:45.233861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-268c4f65-fb95-4f7d-9326-7254cd2b00a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:45.256422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 922/1820] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:45.263366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a712-ac2f-4a11-a23b-3b2df43c326b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:45.264018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a712-ac2f-4a11-a23b-3b2df43c326b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:45.266463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946a712-ac2f-4a11-a23b-3b2df43c326b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:45.308598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f946a712-ac2f-4a11-a23b-3b2df43c326b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:45.310255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f946a712-ac2f-4a11-a23b-3b2df43c326b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:45.407269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 899/1821] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:46:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:45.421624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 923/1822] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:45.431710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4f65-fb95-4f7d-9326-7254cd2b00a3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:45.450259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c4f65-fb95-4f7d-9326-7254cd2b00a3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:45.463780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f9620-3bd1-4cbe-a2f1-5ff43be200a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:45.467413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f9620-3bd1-4cbe-a2f1-5ff43be200a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:45.467900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f9620-3bd1-4cbe-a2f1-5ff43be200a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:45.468394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f9620-3bd1-4cbe-a2f1-5ff43be200a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:45.481763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f9620-3bd1-4cbe-a2f1-5ff43be200a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:46:45.482620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f9620-3bd1-4cbe-a2f1-5ff43be200a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:45.484626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f9620-3bd1-4cbe-a2f1-5ff43be200a0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:45.526720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 900/1823] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:46:45.533851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946a712-ac2f-4a11-a23b-3b2df43c326b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:45.544343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946a712-ac2f-4a11-a23b-3b2df43c326b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:45.554728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa48784-60c4-4b75-83b2-b7de0fc2d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:45.555451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa48784-60c4-4b75-83b2-b7de0fc2d425 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:45.558023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa48784-60c4-4b75-83b2-b7de0fc2d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:45.560018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa48784-60c4-4b75-83b2-b7de0fc2d425 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:45.560909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa48784-60c4-4b75-83b2-b7de0fc2d425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:45.567206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa48784-60c4-4b75-83b2-b7de0fc2d425 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:45.633001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:45.699899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 924/1824] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:45 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:45.704384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f9620-3bd1-4cbe-a2f1-5ff43be200a0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:45.721118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f9620-3bd1-4cbe-a2f1-5ff43be200a0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:45.826144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588326e-deda-4198-b285-02a0f67b318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:45.827016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588326e-deda-4198-b285-02a0f67b318e admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:45.828051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588326e-deda-4198-b285-02a0f67b318e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:45.828404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588326e-deda-4198-b285-02a0f67b318e admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:45.829307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588326e-deda-4198-b285-02a0f67b318e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:45.832163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588326e-deda-4198-b285-02a0f67b318e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:45.917425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa48784-60c4-4b75-83b2-b7de0fc2d425 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:45.920105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9fa48784-60c4-4b75-83b2-b7de0fc2d425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:45.929272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 901/1825] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:45 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:46:45.932855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588326e-deda-4198-b285-02a0f67b318e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:45.944652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588326e-deda-4198-b285-02a0f67b318e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:45.950022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018ab94-6e63-4203-a3a2-6e45bcbf5d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:45.950942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018ab94-6e63-4203-a3a2-6e45bcbf5d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:45.951395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018ab94-6e63-4203-a3a2-6e45bcbf5d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:45.951816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018ab94-6e63-4203-a3a2-6e45bcbf5d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:45.952733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018ab94-6e63-4203-a3a2-6e45bcbf5d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:45.954569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018ab94-6e63-4203-a3a2-6e45bcbf5d73 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:45.972586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 902/1826] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:45.974020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018ab94-6e63-4203-a3a2-6e45bcbf5d73 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:46.001666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018ab94-6e63-4203-a3a2-6e45bcbf5d73 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:46.008766 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b65abd-f34a-42fc-9bfa-119a64e074cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:46.009681 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b65abd-f34a-42fc-9bfa-119a64e074cc admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:46.010238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b65abd-f34a-42fc-9bfa-119a64e074cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:46.012262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b65abd-f34a-42fc-9bfa-119a64e074cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:46.012262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b65abd-f34a-42fc-9bfa-119a64e074cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:46.014797 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b65abd-f34a-42fc-9bfa-119a64e074cc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:46.030540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 903/1827] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:46.034369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b65abd-f34a-42fc-9bfa-119a64e074cc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:46.035097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa48784-60c4-4b75-83b2-b7de0fc2d425 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:46.043254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448ee5f-d4d3-45c8-8f9f-e45d4193a478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:46.043970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ee5f-d4d3-45c8-8f9f-e45d4193a478 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:46.044275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ee5f-d4d3-45c8-8f9f-e45d4193a478 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:46.044689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ee5f-d4d3-45c8-8f9f-e45d4193a478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:46.047518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b65abd-f34a-42fc-9bfa-119a64e074cc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:46.053371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407d8c0-4870-477f-8324-f8c42b70c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:46.054720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d8c0-4870-477f-8324-f8c42b70c45f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:46.055324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d8c0-4870-477f-8324-f8c42b70c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:46.055437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448ee5f-d4d3-45c8-8f9f-e45d4193a478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:46.055836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d8c0-4870-477f-8324-f8c42b70c45f admin admin] PATH_INFO: `/v3/projects/e0bfd2ad525d4b9080e87c70a5f93a8e/users/d027d88d4c464f90a64f2de7e79bf9fa/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:46.057063 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448ee5f-d4d3-45c8-8f9f-e45d4193a478 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:46.070346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 925/1828] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:46.077966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407d8c0-4870-477f-8324-f8c42b70c45f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0bfd2ad525d4b9080e87c70a5f93a8e, user_id=d027d88d4c464f90a64f2de7e79bf9fa, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:46.081082 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407d8c0-4870-477f-8324-f8c42b70c45f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:46.202127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 904/1829] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:46 2022] PUT /identity/v3/projects/e0bfd2ad525d4b9080e87c70a5f93a8e/users/d027d88d4c464f90a64f2de7e79bf9fa/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:46.214573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed93a31-eb27-4dc4-b6bc-85cefee8037a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:46.215535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed93a31-eb27-4dc4-b6bc-85cefee8037a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:46.215830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed93a31-eb27-4dc4-b6bc-85cefee8037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:46.264452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1ed93a31-eb27-4dc4-b6bc-85cefee8037a None None] MFA Rules not processed for user `d027d88d4c464f90a64f2de7e79bf9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:46.265566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1ed93a31-eb27-4dc4-b6bc-85cefee8037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:46.352773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 926/1830] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:46.363087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407d8c0-4870-477f-8324-f8c42b70c45f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:46.496923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407d8c0-4870-477f-8324-f8c42b70c45f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:46.504944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe8bdc-df42-4b01-8d10-992d9bebc1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:46.506880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe8bdc-df42-4b01-8d10-992d9bebc1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:46.507384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe8bdc-df42-4b01-8d10-992d9bebc1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:46.507892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe8bdc-df42-4b01-8d10-992d9bebc1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:46.509089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe8bdc-df42-4b01-8d10-992d9bebc1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:46.513352 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fe8bdc-df42-4b01-8d10-992d9bebc1ef admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:46.557572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:46.644215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 905/1831] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:46 2022] POST /identity/v3/projects => generated 379 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:46.644941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed93a31-eb27-4dc4-b6bc-85cefee8037a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:46.659524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed93a31-eb27-4dc4-b6bc-85cefee8037a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:46.779187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442bf79-1866-47f9-9b1c-32edbc9a64b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:46.780143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442bf79-1866-47f9-9b1c-32edbc9a64b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:46.780840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442bf79-1866-47f9-9b1c-32edbc9a64b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:46.781122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442bf79-1866-47f9-9b1c-32edbc9a64b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:46.781898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442bf79-1866-47f9-9b1c-32edbc9a64b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:46.784167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442bf79-1866-47f9-9b1c-32edbc9a64b2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:46.876145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe8bdc-df42-4b01-8d10-992d9bebc1ef admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:46.878386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d7fe8bdc-df42-4b01-8d10-992d9bebc1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:46.882684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 927/1832] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:46 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:46:46.888039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442bf79-1866-47f9-9b1c-32edbc9a64b2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:46.900503 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442bf79-1866-47f9-9b1c-32edbc9a64b2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:46.908107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe8bdc-df42-4b01-8d10-992d9bebc1ef admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:46.908478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2ee89-8464-4d74-b665-80279ca4e1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:46.908478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2ee89-8464-4d74-b665-80279ca4e1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:46.908478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2ee89-8464-4d74-b665-80279ca4e1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:46.908478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2ee89-8464-4d74-b665-80279ca4e1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:46.909084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2ee89-8464-4d74-b665-80279ca4e1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:46.911359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef2ee89-8464-4d74-b665-80279ca4e1c1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:46.920094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:46.920912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:46.921190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:46.921467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] PATH_INFO: `/v3/projects/ff7e5e2c1e764242b12a352fa7c3039a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:46.922683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7e5e2c1e764242b12a352fa7c3039a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:46.924633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:46.936588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 928/1833] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:46.945000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2ee89-8464-4d74-b665-80279ca4e1c1 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:46.971147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2ee89-8464-4d74-b665-80279ca4e1c1 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:46.991563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ba533-fadb-4583-bd00-a7e027c48424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:46.992252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ba533-fadb-4583-bd00-a7e027c48424 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:46.992536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ba533-fadb-4583-bd00-a7e027c48424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:46.992814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ba533-fadb-4583-bd00-a7e027c48424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:46.993561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ba533-fadb-4583-bd00-a7e027c48424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:46.996339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ba533-fadb-4583-bd00-a7e027c48424 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.014513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 929/1834] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:47.019008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ba533-fadb-4583-bd00-a7e027c48424 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:47.031834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ba533-fadb-4583-bd00-a7e027c48424 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:47.037247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b724f7-155a-45be-a9f7-b5e105f52240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:47.038385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b724f7-155a-45be-a9f7-b5e105f52240 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.038887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b724f7-155a-45be-a9f7-b5e105f52240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.039318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b724f7-155a-45be-a9f7-b5e105f52240 admin admin] PATH_INFO: `/v3/projects/440f1ff728514312a96920b4ae35c2cc/users/d369b487d5fd4291b2d40975e646d401/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.058075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b724f7-155a-45be-a9f7-b5e105f52240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440f1ff728514312a96920b4ae35c2cc, user_id=d369b487d5fd4291b2d40975e646d401, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:47.061414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b724f7-155a-45be-a9f7-b5e105f52240 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.148785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 930/1835] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:47 2022] PUT /identity/v3/projects/440f1ff728514312a96920b4ae35c2cc/users/d369b487d5fd4291b2d40975e646d401/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:47.167457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db2ba-9443-4feb-9582-a968a17b4077 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.169154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db2ba-9443-4feb-9582-a968a17b4077 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.169388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db2ba-9443-4feb-9582-a968a17b4077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.182517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7e5e2c1e764242b12a352fa7c3039a', 'request_id': 'req-21d240ef-d965-45cb-9ec1-e5d3b763b247'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:47.192438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7e5e2c1e764242b12a352fa7c3039a', 'request_id': 'req-21d240ef-d965-45cb-9ec1-e5d3b763b247'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:47.231774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cf0db2ba-9443-4feb-9582-a968a17b4077 None None] MFA Rules not processed for user `d369b487d5fd4291b2d40975e646d401`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:47.233413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cf0db2ba-9443-4feb-9582-a968a17b4077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:47.316380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7e5e2c1e764242b12a352fa7c3039a', 'request_id': 'req-21d240ef-d965-45cb-9ec1-e5d3b763b247'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:47.324684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 931/1836] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:47.324684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db2ba-9443-4feb-9582-a968a17b4077 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:47.330670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] The token cache is being invalidate because project ff7e5e2c1e764242b12a352fa7c3039a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:47.331269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:47.332134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-21d240ef-d965-45cb-9ec1-e5d3b763b247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:47.334230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 906/1837] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:46 2022] DELETE /identity/v3/projects/ff7e5e2c1e764242b12a352fa7c3039a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:47.340083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b818ca-7049-4302-b143-11423d7137f7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.340461 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b818ca-7049-4302-b143-11423d7137f7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.340814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b818ca-7049-4302-b143-11423d7137f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.360204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a5b818ca-7049-4302-b143-11423d7137f7 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:47.362239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a5b818ca-7049-4302-b143-11423d7137f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:47.400078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db2ba-9443-4feb-9582-a968a17b4077 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:47.405143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9e69d-6a09-4cf9-b482-2bb7eb7e00dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:47.405818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9e69d-6a09-4cf9-b482-2bb7eb7e00dc admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.406341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9e69d-6a09-4cf9-b482-2bb7eb7e00dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.406341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9e69d-6a09-4cf9-b482-2bb7eb7e00dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.407102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9e69d-6a09-4cf9-b482-2bb7eb7e00dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:47.409065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9e69d-6a09-4cf9-b482-2bb7eb7e00dc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.444011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 907/1838] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:47.452903 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067305-a054-4966-a341-c8af69711f4e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.453199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067305-a054-4966-a341-c8af69711f4e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.453478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b067305-a054-4966-a341-c8af69711f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.472093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0b067305-a054-4966-a341-c8af69711f4e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:47.473281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0b067305-a054-4966-a341-c8af69711f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:47.482289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 908/1839] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:47.488454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b067305-a054-4966-a341-c8af69711f4e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:47.495434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b067305-a054-4966-a341-c8af69711f4e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:47.500176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598579b4-3a38-457e-ac8f-4c7232265b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:47.500882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598579b4-3a38-457e-ac8f-4c7232265b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.501173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598579b4-3a38-457e-ac8f-4c7232265b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.501455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598579b4-3a38-457e-ac8f-4c7232265b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.502188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598579b4-3a38-457e-ac8f-4c7232265b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:46:47.502497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598579b4-3a38-457e-ac8f-4c7232265b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:47.504262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598579b4-3a38-457e-ac8f-4c7232265b03 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.517130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 909/1840] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:46:47.521378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598579b4-3a38-457e-ac8f-4c7232265b03 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:47.537683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598579b4-3a38-457e-ac8f-4c7232265b03 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:47.538274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 932/1841] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:47 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:47.543337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9e69d-6a09-4cf9-b482-2bb7eb7e00dc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:47.545055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b8a9e69d-6a09-4cf9-b482-2bb7eb7e00dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:47.649045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9e69d-6a09-4cf9-b482-2bb7eb7e00dc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:47.656417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2549-9347-4deb-99dc-bb79e672772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:47.657111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2549-9347-4deb-99dc-bb79e672772d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.657429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2549-9347-4deb-99dc-bb79e672772d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.657711 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2549-9347-4deb-99dc-bb79e672772d admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.658719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2549-9347-4deb-99dc-bb79e672772d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:47.660532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2549-9347-4deb-99dc-bb79e672772d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.664311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bacadc-25c2-47e5-9edc-390eefaee0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:47.674604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bacadc-25c2-47e5-9edc-390eefaee0e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.674921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bacadc-25c2-47e5-9edc-390eefaee0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.675212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bacadc-25c2-47e5-9edc-390eefaee0e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.677150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bacadc-25c2-47e5-9edc-390eefaee0e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:47.678001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bacadc-25c2-47e5-9edc-390eefaee0e9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.777391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 933/1842] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:47 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:47.781110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2549-9347-4deb-99dc-bb79e672772d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:47.788728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:47.795272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 910/1843] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:47 2022] POST /identity/v3/projects => generated 373 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:46:47.799173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bacadc-25c2-47e5-9edc-390eefaee0e9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:47.813808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2549-9347-4deb-99dc-bb79e672772d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:47.866603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bacadc-25c2-47e5-9edc-390eefaee0e9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:47.872557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb0be-e6d8-41b5-8433-ee015a0cc30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:47.873242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb0be-e6d8-41b5-8433-ee015a0cc30b admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.875483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb0be-e6d8-41b5-8433-ee015a0cc30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.875483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eeb0be-e6d8-41b5-8433-ee015a0cc30b admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.875483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeb0be-e6d8-41b5-8433-ee015a0cc30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:47.876472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eeb0be-e6d8-41b5-8433-ee015a0cc30b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.882969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d17597-c523-4064-aef7-8f892f5f4ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:47.883817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d17597-c523-4064-aef7-8f892f5f4ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.884099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d17597-c523-4064-aef7-8f892f5f4ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.885618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d17597-c523-4064-aef7-8f892f5f4ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.885816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d17597-c523-4064-aef7-8f892f5f4ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:47.887772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d17597-c523-4064-aef7-8f892f5f4ba9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.898389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 934/1844] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:47.902769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d17597-c523-4064-aef7-8f892f5f4ba9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:47.912884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d17597-c523-4064-aef7-8f892f5f4ba9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:47.918388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38502fd2-0aa2-4ff1-afbc-10128a5611c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:47.919315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502fd2-0aa2-4ff1-afbc-10128a5611c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.919597 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502fd2-0aa2-4ff1-afbc-10128a5611c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.919885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38502fd2-0aa2-4ff1-afbc-10128a5611c5 admin admin] PATH_INFO: `/v3/projects/5b8872a786534b2795b5b315bdea551e/users/61af6de4b4c84356b4c06463e28472d4/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.935603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38502fd2-0aa2-4ff1-afbc-10128a5611c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8872a786534b2795b5b315bdea551e, user_id=61af6de4b4c84356b4c06463e28472d4, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:47.938292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38502fd2-0aa2-4ff1-afbc-10128a5611c5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.958953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 911/1845] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:47 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:46:47.962990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb0be-e6d8-41b5-8433-ee015a0cc30b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:47.972962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eeb0be-e6d8-41b5-8433-ee015a0cc30b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:47.977779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9709c5-fbdb-4260-b6e2-3bb111a0d1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:47.979161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9709c5-fbdb-4260-b6e2-3bb111a0d1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:47.979523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9709c5-fbdb-4260-b6e2-3bb111a0d1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:47.979762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9709c5-fbdb-4260-b6e2-3bb111a0d1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:47.980509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9709c5-fbdb-4260-b6e2-3bb111a0d1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:47.982164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9709c5-fbdb-4260-b6e2-3bb111a0d1ed admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:47.992270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 912/1846] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:47.996997 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9709c5-fbdb-4260-b6e2-3bb111a0d1ed admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:48.007423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9709c5-fbdb-4260-b6e2-3bb111a0d1ed admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:48.012580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cea72-06a9-4abb-8237-5c3aff151566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:48.013271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cea72-06a9-4abb-8237-5c3aff151566 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:48.013566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cea72-06a9-4abb-8237-5c3aff151566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:48.013852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cea72-06a9-4abb-8237-5c3aff151566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:48.014631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cea72-06a9-4abb-8237-5c3aff151566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:48.016258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cea72-06a9-4abb-8237-5c3aff151566 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:48.027514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 913/1847] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:48.031285 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cea72-06a9-4abb-8237-5c3aff151566 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:48.034424 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 935/1848] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:47 2022] PUT /identity/v3/projects/5b8872a786534b2795b5b315bdea551e/users/61af6de4b4c84356b4c06463e28472d4/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:48.038169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38502fd2-0aa2-4ff1-afbc-10128a5611c5 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:48.043158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cea72-06a9-4abb-8237-5c3aff151566 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:48.102890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38502fd2-0aa2-4ff1-afbc-10128a5611c5 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:48.109390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1cfe2-a8f5-4f4a-9409-cd5738ed1fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:48.110068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1cfe2-a8f5-4f4a-9409-cd5738ed1fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:48.110358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1cfe2-a8f5-4f4a-9409-cd5738ed1fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:48.110643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1cfe2-a8f5-4f4a-9409-cd5738ed1fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:48.111455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1cfe2-a8f5-4f4a-9409-cd5738ed1fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:48.112491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af1518-155a-48d2-a5e7-5280bb8fdec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:48.113397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af1518-155a-48d2-a5e7-5280bb8fdec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:48.113505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1cfe2-a8f5-4f4a-9409-cd5738ed1fe6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:48.113850 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af1518-155a-48d2-a5e7-5280bb8fdec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:48.114183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af1518-155a-48d2-a5e7-5280bb8fdec6 admin admin] PATH_INFO: `/v3/projects/812d84ac76f44eabab5511b435951bb2/users/c07da5f3c8a043efba0b4d12f2763bb4/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:48.125035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 936/1849] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:48.129184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1cfe2-a8f5-4f4a-9409-cd5738ed1fe6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:48.137120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af1518-155a-48d2-a5e7-5280bb8fdec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=812d84ac76f44eabab5511b435951bb2, user_id=c07da5f3c8a043efba0b4d12f2763bb4, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:48.139850 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af1518-155a-48d2-a5e7-5280bb8fdec6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:48.139978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1cfe2-a8f5-4f4a-9409-cd5738ed1fe6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:48.145246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca888a2-83da-4060-9137-be919cc15a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:48.146181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca888a2-83da-4060-9137-be919cc15a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:48.146559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca888a2-83da-4060-9137-be919cc15a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:48.146871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca888a2-83da-4060-9137-be919cc15a2e admin admin] PATH_INFO: `/v3/projects/5b8872a786534b2795b5b315bdea551e/users/61af6de4b4c84356b4c06463e28472d4/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:48.148900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca888a2-83da-4060-9137-be919cc15a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8872a786534b2795b5b315bdea551e, user_id=61af6de4b4c84356b4c06463e28472d4, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:48.151673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca888a2-83da-4060-9137-be919cc15a2e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:48.162206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 937/1850] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:48 2022] PUT /identity/v3/projects/5b8872a786534b2795b5b315bdea551e/users/61af6de4b4c84356b4c06463e28472d4/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:48.173570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6d3f-eec9-48be-b1b9-bc53b85e7432 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:48.173863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6d3f-eec9-48be-b1b9-bc53b85e7432 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:48.174144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a6d3f-eec9-48be-b1b9-bc53b85e7432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:48.208930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-672a6d3f-eec9-48be-b1b9-bc53b85e7432 None None] MFA Rules not processed for user `61af6de4b4c84356b4c06463e28472d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:48.209183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-672a6d3f-eec9-48be-b1b9-bc53b85e7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:48.240449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 914/1851] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:48 2022] PUT /identity/v3/projects/812d84ac76f44eabab5511b435951bb2/users/c07da5f3c8a043efba0b4d12f2763bb4/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:48.254354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03289e5d-001a-4b5f-822e-738407473b18 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:48.254716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03289e5d-001a-4b5f-822e-738407473b18 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:48.255286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03289e5d-001a-4b5f-822e-738407473b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:48.308221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-03289e5d-001a-4b5f-822e-738407473b18 None None] MFA Rules not processed for user `c07da5f3c8a043efba0b4d12f2763bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:48.309461 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-03289e5d-001a-4b5f-822e-738407473b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:48.347353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:48.358942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 938/1852] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:48.379034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6d3f-eec9-48be-b1b9-bc53b85e7432 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:48.380882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-672a6d3f-eec9-48be-b1b9-bc53b85e7432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:48.433416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 915/1853] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:46:48.450103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03289e5d-001a-4b5f-822e-738407473b18 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:48.451745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-03289e5d-001a-4b5f-822e-738407473b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:48.469496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a6d3f-eec9-48be-b1b9-bc53b85e7432 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:48.536339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa618-01a2-49c2-8b8b-14fcd935a2f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:48.537150 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa618-01a2-49c2-8b8b-14fcd935a2f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:48.537447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa618-01a2-49c2-8b8b-14fcd935a2f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:48.537759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2aa618-01a2-49c2-8b8b-14fcd935a2f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:48.542819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03289e5d-001a-4b5f-822e-738407473b18 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:48.546638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ab793-e029-4207-ae9d-e86c3b17963e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0a8a5a1bc174acd9b13477c7d4b4a07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:48.547350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ab793-e029-4207-ae9d-e86c3b17963e service glance] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:48.547639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ab793-e029-4207-ae9d-e86c3b17963e service glance] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:48.547970 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ab793-e029-4207-ae9d-e86c3b17963e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:48.560205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ab793-e029-4207-ae9d-e86c3b17963e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:48.562131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ab793-e029-4207-ae9d-e86c3b17963e service glance] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:48.580604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 916/1854] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:46:48.630993 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aa618-01a2-49c2-8b8b-14fcd935a2f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:48.633187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2aa618-01a2-49c2-8b8b-14fcd935a2f2 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:48.658080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 939/1855] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:48.789807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ab793-e029-4207-ae9d-e86c3b17963e service glance] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:48.803631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ab793-e029-4207-ae9d-e86c3b17963e service glance] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:48.812236 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0813b-ec39-42f7-8b4c-f85903a8047c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:48.812899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0813b-ec39-42f7-8b4c-f85903a8047c service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:48.813185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0813b-ec39-42f7-8b4c-f85903a8047c service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:48.813457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0813b-ec39-42f7-8b4c-f85903a8047c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:48.818360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f1d0813b-ec39-42f7-8b4c-f85903a8047c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:48.903243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0813b-ec39-42f7-8b4c-f85903a8047c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:48.905991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0813b-ec39-42f7-8b4c-f85903a8047c service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:48.917619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 917/1856] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:49.391785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:50.665314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:52.366621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:53.371532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa618-01a2-49c2-8b8b-14fcd935a2f2 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:53.531069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2aa618-01a2-49c2-8b8b-14fcd935a2f2 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:53.537055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:53.537965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:53.538250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:53.538526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] PATH_INFO: `/v3/users/d027d88d4c464f90a64f2de7e79bf9fa` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:53.544797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d027d88d4c464f90a64f2de7e79bf9fa)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:53.552174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:53.749053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd027d88d4c464f90a64f2de7e79bf9fa'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:53.761646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd027d88d4c464f90a64f2de7e79bf9fa'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:53.839022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd027d88d4c464f90a64f2de7e79bf9fa'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:53.839578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd027d88d4c464f90a64f2de7e79bf9fa'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:53.847317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd027d88d4c464f90a64f2de7e79bf9fa'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:53.854318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 940/1857] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:53 2022] DELETE /identity/v3/users/d027d88d4c464f90a64f2de7e79bf9fa => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:53.858778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ade4ba-5f0d-4573-bc9b-908451be712b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:53.859304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ade4ba-5f0d-4573-bc9b-908451be712b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:53.859394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ade4ba-5f0d-4573-bc9b-908451be712b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:53.878056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-82ade4ba-5f0d-4573-bc9b-908451be712b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:53.879278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-82ade4ba-5f0d-4573-bc9b-908451be712b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:53.949042 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 918/1858] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:53.958897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:53.960327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:54.018749 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef910d7d-8a6d-4e74-b6e4-246cf91bef4d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:54.022435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36acc3-7b6a-4305-8101-d43c390682dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:54.023121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36acc3-7b6a-4305-8101-d43c390682dd service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:54.023412 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36acc3-7b6a-4305-8101-d43c390682dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:54.023693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36acc3-7b6a-4305-8101-d43c390682dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:54.028064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:54.033627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36acc3-7b6a-4305-8101-d43c390682dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:54.035112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36acc3-7b6a-4305-8101-d43c390682dd service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:54.044466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 941/1859] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:46:54.810189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ade4ba-5f0d-4573-bc9b-908451be712b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:54.811598 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-82ade4ba-5f0d-4573-bc9b-908451be712b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:54.824054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ade4ba-5f0d-4573-bc9b-908451be712b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:54.829353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:54.830256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:54.830539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:54.830817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] PATH_INFO: `/v3/projects/e0bfd2ad525d4b9080e87c70a5f93a8e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:54.832044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0bfd2ad525d4b9080e87c70a5f93a8e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:54.833975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:54.976607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0bfd2ad525d4b9080e87c70a5f93a8e', 'request_id': 'req-1d07ca10-2c70-49a6-a422-940c5e2f243a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:54.982272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0bfd2ad525d4b9080e87c70a5f93a8e', 'request_id': 'req-1d07ca10-2c70-49a6-a422-940c5e2f243a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:55.044291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0bfd2ad525d4b9080e87c70a5f93a8e', 'request_id': 'req-1d07ca10-2c70-49a6-a422-940c5e2f243a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:55.057650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] The token cache is being invalidate because project e0bfd2ad525d4b9080e87c70a5f93a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:55.057964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:55.058612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:55.060204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 919/1860] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:54 2022] DELETE /identity/v3/projects/e0bfd2ad525d4b9080e87c70a5f93a8e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:55.064326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36acc3-7b6a-4305-8101-d43c390682dd service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:55.075309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36acc3-7b6a-4305-8101-d43c390682dd service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:55.138551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:55.139371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:55.139658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:55.139934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] PATH_INFO: `/v3/users/d369b487d5fd4291b2d40975e646d401` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:55.141305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d369b487d5fd4291b2d40975e646d401)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:55.143292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:55.376017 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:55.390805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd369b487d5fd4291b2d40975e646d401'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:55.403219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd369b487d5fd4291b2d40975e646d401'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:55.542555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd369b487d5fd4291b2d40975e646d401'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:55.543936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd369b487d5fd4291b2d40975e646d401'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:55.552932 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd369b487d5fd4291b2d40975e646d401'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:55.561425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 942/1861] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:55 2022] DELETE /identity/v3/users/d369b487d5fd4291b2d40975e646d401 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:56.047014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:56.049444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:56.077635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07ca10-2c70-49a6-a422-940c5e2f243a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:56.143996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:56.144831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:56.145119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:56.145584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] PATH_INFO: `/v3/projects/440f1ff728514312a96920b4ae35c2cc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:56.146784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440f1ff728514312a96920b4ae35c2cc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:56.148742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:56.258349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440f1ff728514312a96920b4ae35c2cc', 'request_id': 'req-1548c010-b448-424e-a348-628bd352b1b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.266640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440f1ff728514312a96920b4ae35c2cc', 'request_id': 'req-1548c010-b448-424e-a348-628bd352b1b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.341579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440f1ff728514312a96920b4ae35c2cc', 'request_id': 'req-1548c010-b448-424e-a348-628bd352b1b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.363269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] The token cache is being invalidate because project 440f1ff728514312a96920b4ae35c2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:56.363624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.365065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.366892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 920/1862] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:56 2022] DELETE /identity/v3/projects/440f1ff728514312a96920b4ae35c2cc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:56.371539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:56.373055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:56.386823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a891fd-0c86-499d-8107-5c9e1aeabf45 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:56.460545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:56.465039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:56.465039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:56.465039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] PATH_INFO: `/v3/users/61af6de4b4c84356b4c06463e28472d4` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:56.465039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61af6de4b4c84356b4c06463e28472d4)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:56.466524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:56.631741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:56.721671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61af6de4b4c84356b4c06463e28472d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.734565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61af6de4b4c84356b4c06463e28472d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.819365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61af6de4b4c84356b4c06463e28472d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.819994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61af6de4b4c84356b4c06463e28472d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.828373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ac37d7da-c8e1-4eb0-aed7-e699981ac259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61af6de4b4c84356b4c06463e28472d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:56.834557 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 943/1863] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:46:56 2022] DELETE /identity/v3/users/61af6de4b4c84356b4c06463e28472d4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:57.078325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:57.277331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:57.279746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:57.297723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548c010-b448-424e-a348-628bd352b1b3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:57.376919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:57.377872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:57.378119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:57.378401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] PATH_INFO: `/v3/projects/5b8872a786534b2795b5b315bdea551e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:57.379629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8872a786534b2795b5b315bdea551e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:57.381564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:57.568363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8872a786534b2795b5b315bdea551e', 'request_id': 'req-14635a05-6c52-48f4-850e-c1354d8dbd50'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:57.575890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8872a786534b2795b5b315bdea551e', 'request_id': 'req-14635a05-6c52-48f4-850e-c1354d8dbd50'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:57.647671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8872a786534b2795b5b315bdea551e', 'request_id': 'req-14635a05-6c52-48f4-850e-c1354d8dbd50'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:57.660048 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] The token cache is being invalidate because project 5b8872a786534b2795b5b315bdea551e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:46:57.660342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:57.660975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-14635a05-6c52-48f4-850e-c1354d8dbd50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:46:57.662573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 921/1864] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:46:57 2022] DELETE /identity/v3/projects/5b8872a786534b2795b5b315bdea551e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:46:57.669132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca4513-297e-4d2b-bcaf-40f0fccd82fb None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:57.669643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca4513-297e-4d2b-bcaf-40f0fccd82fb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:57.669732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca4513-297e-4d2b-bcaf-40f0fccd82fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:57.690681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7dca4513-297e-4d2b-bcaf-40f0fccd82fb None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:57.692295 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7dca4513-297e-4d2b-bcaf-40f0fccd82fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:57.755251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 944/1865] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:57.765309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa886944-5fbe-4b5b-9e16-fa0dd5d1f961 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:57.765670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa886944-5fbe-4b5b-9e16-fa0dd5d1f961 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:57.765960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa886944-5fbe-4b5b-9e16-fa0dd5d1f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:57.786182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fa886944-5fbe-4b5b-9e16-fa0dd5d1f961 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:57.787466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fa886944-5fbe-4b5b-9e16-fa0dd5d1f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:57.796411 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 922/1866] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:57.800806 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca4513-297e-4d2b-bcaf-40f0fccd82fb None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:57.811718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca4513-297e-4d2b-bcaf-40f0fccd82fb None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:57.816817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c84667-2934-4acd-ac6d-6f72b2dc479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:57.818276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c84667-2934-4acd-ac6d-6f72b2dc479f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:57.818567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c84667-2934-4acd-ac6d-6f72b2dc479f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:57.818867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c84667-2934-4acd-ac6d-6f72b2dc479f admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:57.819609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c84667-2934-4acd-ac6d-6f72b2dc479f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:46:57.819915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c84667-2934-4acd-ac6d-6f72b2dc479f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:57.821552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c84667-2934-4acd-ac6d-6f72b2dc479f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:57.838267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 945/1867] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:46:57.839675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa886944-5fbe-4b5b-9e16-fa0dd5d1f961 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:57.849980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa886944-5fbe-4b5b-9e16-fa0dd5d1f961 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:57.855517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7b6b5-9316-4add-8a73-3fa4774f9157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:57.856329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7b6b5-9316-4add-8a73-3fa4774f9157 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:57.856626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7b6b5-9316-4add-8a73-3fa4774f9157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:57.856905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7b6b5-9316-4add-8a73-3fa4774f9157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:57.857800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7b6b5-9316-4add-8a73-3fa4774f9157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:57.859809 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7b6b5-9316-4add-8a73-3fa4774f9157 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:57.968651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 923/1868] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:57 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:57.969419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c84667-2934-4acd-ac6d-6f72b2dc479f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:57.981707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c84667-2934-4acd-ac6d-6f72b2dc479f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:58.077742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce4b8f-384e-47b4-859a-bd3ef3b98c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:58.078435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce4b8f-384e-47b4-859a-bd3ef3b98c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:58.078724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce4b8f-384e-47b4-859a-bd3ef3b98c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:58.079053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce4b8f-384e-47b4-859a-bd3ef3b98c38 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:58.080584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce4b8f-384e-47b4-859a-bd3ef3b98c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:58.082565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce4b8f-384e-47b4-859a-bd3ef3b98c38 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:58.191536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 946/1869] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:57 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:58.198479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7b6b5-9316-4add-8a73-3fa4774f9157 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:58.222058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7b6b5-9316-4add-8a73-3fa4774f9157 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:58.236631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70282e3-9f16-485a-b869-0de37353329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:58.237346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70282e3-9f16-485a-b869-0de37353329a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:58.237634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70282e3-9f16-485a-b869-0de37353329a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:58.237910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70282e3-9f16-485a-b869-0de37353329a admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:58.238646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70282e3-9f16-485a-b869-0de37353329a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:58.241033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70282e3-9f16-485a-b869-0de37353329a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:58.254125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:58.255155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 924/1870] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:58.258664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce4b8f-384e-47b4-859a-bd3ef3b98c38 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:58.270110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce4b8f-384e-47b4-859a-bd3ef3b98c38 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:58.276221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401afdce-8c15-4144-8283-33bc8d4fdf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:58.277524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401afdce-8c15-4144-8283-33bc8d4fdf45 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:58.277812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401afdce-8c15-4144-8283-33bc8d4fdf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:58.278096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401afdce-8c15-4144-8283-33bc8d4fdf45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:58.278921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401afdce-8c15-4144-8283-33bc8d4fdf45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:58.280620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401afdce-8c15-4144-8283-33bc8d4fdf45 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:58.296568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 947/1871] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:58.298043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70282e3-9f16-485a-b869-0de37353329a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:58.306418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:58.312566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70282e3-9f16-485a-b869-0de37353329a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:58.318324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c1ff2-cc29-4403-a9d7-1fc2d6247159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:58.318324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c1ff2-cc29-4403-a9d7-1fc2d6247159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:58.318324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c1ff2-cc29-4403-a9d7-1fc2d6247159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:58.318644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c1ff2-cc29-4403-a9d7-1fc2d6247159 admin admin] PATH_INFO: `/v3/projects/b5e484f65c8f4f9aa238c538146d087f/users/3e04f0c860c348a996f5f029d5c9ef6c/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:58.333116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c1ff2-cc29-4403-a9d7-1fc2d6247159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5e484f65c8f4f9aa238c538146d087f, user_id=3e04f0c860c348a996f5f029d5c9ef6c, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:58.335876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c1ff2-cc29-4403-a9d7-1fc2d6247159 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:58.416740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 925/1872] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:58 2022] PUT /identity/v3/projects/b5e484f65c8f4f9aa238c538146d087f/users/3e04f0c860c348a996f5f029d5c9ef6c/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:58.433353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55678-e168-49aa-8c09-a4198f063a48 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:58.433353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55678-e168-49aa-8c09-a4198f063a48 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:58.433353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa55678-e168-49aa-8c09-a4198f063a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:58.479619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2fa55678-e168-49aa-8c09-a4198f063a48 None None] MFA Rules not processed for user `3e04f0c860c348a996f5f029d5c9ef6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:58.481111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2fa55678-e168-49aa-8c09-a4198f063a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:58.602414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 948/1873] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:58.606814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c1ff2-cc29-4403-a9d7-1fc2d6247159 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:58.686479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c1ff2-cc29-4403-a9d7-1fc2d6247159 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:58.692827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce9146-9f69-4b84-a94f-373f82747dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:58.693739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce9146-9f69-4b84-a94f-373f82747dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:58.694088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce9146-9f69-4b84-a94f-373f82747dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:58.694494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce9146-9f69-4b84-a94f-373f82747dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:58.695455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce9146-9f69-4b84-a94f-373f82747dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:58.698111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce9146-9f69-4b84-a94f-373f82747dd0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:58.818759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 926/1874] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:46:58 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:46:58.823247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa55678-e168-49aa-8c09-a4198f063a48 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:58.835832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa55678-e168-49aa-8c09-a4198f063a48 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:58.897542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d4bc9-4594-4d49-a43c-86a86b8b2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:58.898228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d4bc9-4594-4d49-a43c-86a86b8b2c62 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:58.898516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d4bc9-4594-4d49-a43c-86a86b8b2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:58.898982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d4bc9-4594-4d49-a43c-86a86b8b2c62 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:58.899842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d4bc9-4594-4d49-a43c-86a86b8b2c62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:58.902631 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d4bc9-4594-4d49-a43c-86a86b8b2c62 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:58.984094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 949/1875] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:46:58 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:46:58.985432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce9146-9f69-4b84-a94f-373f82747dd0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:58.996513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce9146-9f69-4b84-a94f-373f82747dd0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:58.997456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:59.004651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43e4d-41f0-4988-867b-43e34ee7e205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:59.004651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43e4d-41f0-4988-867b-43e34ee7e205 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:59.004651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43e4d-41f0-4988-867b-43e34ee7e205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:59.004651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b43e4d-41f0-4988-867b-43e34ee7e205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:59.004988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43e4d-41f0-4988-867b-43e34ee7e205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:59.005738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b43e4d-41f0-4988-867b-43e34ee7e205 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:59.016932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 927/1876] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:46:59.021251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d4bc9-4594-4d49-a43c-86a86b8b2c62 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:59.032168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d4bc9-4594-4d49-a43c-86a86b8b2c62 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:59.037223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca144d-f309-4323-8219-ae0fd5be0ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:59.038129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca144d-f309-4323-8219-ae0fd5be0ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:59.038596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca144d-f309-4323-8219-ae0fd5be0ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:59.038786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca144d-f309-4323-8219-ae0fd5be0ef8 admin admin] PATH_INFO: `/v3/projects/4b2e99b5132a4c21a62c0e63ec77d468/users/49fe03dbac174ff38334de43e4e6e800/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:59.056377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca144d-f309-4323-8219-ae0fd5be0ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2e99b5132a4c21a62c0e63ec77d468, user_id=49fe03dbac174ff38334de43e4e6e800, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:59.058518 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca144d-f309-4323-8219-ae0fd5be0ef8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:59.085912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:59.139091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 950/1877] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:59 2022] PUT /identity/v3/projects/4b2e99b5132a4c21a62c0e63ec77d468/users/49fe03dbac174ff38334de43e4e6e800/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:59.143205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43e4d-41f0-4988-867b-43e34ee7e205 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:59.156397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b43e4d-41f0-4988-867b-43e34ee7e205 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:59.247574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e8f31-f6a6-47ab-a643-8ff6ebf0e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:59.248251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e8f31-f6a6-47ab-a643-8ff6ebf0e43b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:59.253825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e8f31-f6a6-47ab-a643-8ff6ebf0e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:59.253825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e8f31-f6a6-47ab-a643-8ff6ebf0e43b admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:59.253825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e8f31-f6a6-47ab-a643-8ff6ebf0e43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:59.253825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e8f31-f6a6-47ab-a643-8ff6ebf0e43b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:59.266195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 928/1878] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:46:59.266929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca144d-f309-4323-8219-ae0fd5be0ef8 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:59.280091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca144d-f309-4323-8219-ae0fd5be0ef8 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:59.285245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2e515-08b4-4557-9a72-2e9abcec6b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:59.286182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2e515-08b4-4557-9a72-2e9abcec6b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:59.286945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2e515-08b4-4557-9a72-2e9abcec6b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:59.286945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a2e515-08b4-4557-9a72-2e9abcec6b6c admin admin] PATH_INFO: `/v3/projects/4b2e99b5132a4c21a62c0e63ec77d468/users/49fe03dbac174ff38334de43e4e6e800/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:59.289005 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2e515-08b4-4557-9a72-2e9abcec6b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2e99b5132a4c21a62c0e63ec77d468, user_id=49fe03dbac174ff38334de43e4e6e800, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:59.293522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a2e515-08b4-4557-9a72-2e9abcec6b6c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:59.309908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 951/1879] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:46:59 2022] PUT /identity/v3/projects/4b2e99b5132a4c21a62c0e63ec77d468/users/49fe03dbac174ff38334de43e4e6e800/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:46:59.320275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8cb24-ca97-44ef-bf3a-805849fe0c39 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:59.320800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8cb24-ca97-44ef-bf3a-805849fe0c39 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:59.320893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8cb24-ca97-44ef-bf3a-805849fe0c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:59.347882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:46:59.360686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-13f8cb24-ca97-44ef-bf3a-805849fe0c39 None None] MFA Rules not processed for user `49fe03dbac174ff38334de43e4e6e800`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:46:59.361983 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-13f8cb24-ca97-44ef-bf3a-805849fe0c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:59.467420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 929/1880] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:46:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:46:59.484614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2e515-08b4-4557-9a72-2e9abcec6b6c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:46:59.487059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b0a2e515-08b4-4557-9a72-2e9abcec6b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:46:59.579787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a2e515-08b4-4557-9a72-2e9abcec6b6c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:46:59.585187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090c94-5859-4686-9b96-77261b92b873 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:46:59.586186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090c94-5859-4686-9b96-77261b92b873 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:46:59.588384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090c94-5859-4686-9b96-77261b92b873 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:46:59.588809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0090c94-5859-4686-9b96-77261b92b873 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:46:59.727527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0090c94-5859-4686-9b96-77261b92b873 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:46:59.729678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0090c94-5859-4686-9b96-77261b92b873 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:46:59.749059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 952/1881] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:46:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:00.346432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:00.654686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:01.813584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:01.985520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:06.589168 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8cb24-ca97-44ef-bf3a-805849fe0c39 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:06.599429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8cb24-ca97-44ef-bf3a-805849fe0c39 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:06.604080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5ce44-94ca-476a-9de8-948094ddc295 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:06.604973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ce44-94ca-476a-9de8-948094ddc295 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:06.605432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ce44-94ca-476a-9de8-948094ddc295 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:06.605916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5ce44-94ca-476a-9de8-948094ddc295 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:06.616607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5ce44-94ca-476a-9de8-948094ddc295 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:06.618398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5ce44-94ca-476a-9de8-948094ddc295 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:06.633893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 930/1882] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:12.731903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:13.120262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090c94-5859-4686-9b96-77261b92b873 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:13.121808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f0090c94-5859-4686-9b96-77261b92b873 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:13.190783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0090c94-5859-4686-9b96-77261b92b873 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:13.195988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:13.196909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:13.198109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:13.198532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] PATH_INFO: `/v3/users/099c5f9c851e4253bc865d87986063ce` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:13.199999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099c5f9c851e4253bc865d87986063ce)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:13.202091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:13.468960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099c5f9c851e4253bc865d87986063ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:13.483061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099c5f9c851e4253bc865d87986063ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:13.563432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099c5f9c851e4253bc865d87986063ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:13.564105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099c5f9c851e4253bc865d87986063ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:13.573930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d889f47f-f839-4882-9f06-0cbfc7c9c5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099c5f9c851e4253bc865d87986063ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:13.579837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5ce44-94ca-476a-9de8-948094ddc295 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:13.584581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 953/1883] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:13 2022] DELETE /identity/v3/users/099c5f9c851e4253bc865d87986063ce => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:13.590475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9890ff-ec1c-4a17-add1-49a2e943ca4c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:13.590869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9890ff-ec1c-4a17-add1-49a2e943ca4c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:13.591213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9890ff-ec1c-4a17-add1-49a2e943ca4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:13.597216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5ce44-94ca-476a-9de8-948094ddc295 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:13.615723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ab9890ff-ec1c-4a17-add1-49a2e943ca4c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:13.617183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ab9890ff-ec1c-4a17-add1-49a2e943ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:13.671955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:13.673594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:13.674185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:13.675005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] PATH_INFO: `/v3/users/3e04f0c860c348a996f5f029d5c9ef6c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:13.676700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e04f0c860c348a996f5f029d5c9ef6c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:13.679690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:13.691969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 954/1884] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:13.705082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9890ff-ec1c-4a17-add1-49a2e943ca4c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:13.707198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ab9890ff-ec1c-4a17-add1-49a2e943ca4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:13.733174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:13.774790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9890ff-ec1c-4a17-add1-49a2e943ca4c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:13.779111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb1de0-8d2d-4705-b6f5-f168786c29f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:13.779785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb1de0-8d2d-4705-b6f5-f168786c29f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:13.780099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb1de0-8d2d-4705-b6f5-f168786c29f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:13.780381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb1de0-8d2d-4705-b6f5-f168786c29f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:13.790359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb1de0-8d2d-4705-b6f5-f168786c29f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:13.791964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb1de0-8d2d-4705-b6f5-f168786c29f6 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:13.802828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 955/1885] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:13.875096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:13.901757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e04f0c860c348a996f5f029d5c9ef6c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:13.902511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e04f0c860c348a996f5f029d5c9ef6c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:13.919647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e04f0c860c348a996f5f029d5c9ef6c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:13.932650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e04f0c860c348a996f5f029d5c9ef6c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:14.050964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e04f0c860c348a996f5f029d5c9ef6c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:14.058138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 931/1886] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:13 2022] DELETE /identity/v3/users/3e04f0c860c348a996f5f029d5c9ef6c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:14.062988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b09c6f-0c1a-4436-88f5-47e40b25e837 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:14.063391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b09c6f-0c1a-4436-88f5-47e40b25e837 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:14.063773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b09c6f-0c1a-4436-88f5-47e40b25e837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:14.081772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c4b09c6f-0c1a-4436-88f5-47e40b25e837 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:14.084388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c4b09c6f-0c1a-4436-88f5-47e40b25e837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:14.156136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 956/1887] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:14.166337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:14.168420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:14.233409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90c7a-bfea-417a-b502-76006add1641 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:14.237069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba661e-dfc9-45c7-bbfd-2bda90096311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:14.237760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba661e-dfc9-45c7-bbfd-2bda90096311 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:14.238053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba661e-dfc9-45c7-bbfd-2bda90096311 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:14.238338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba661e-dfc9-45c7-bbfd-2bda90096311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:14.249866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba661e-dfc9-45c7-bbfd-2bda90096311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:14.251658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba661e-dfc9-45c7-bbfd-2bda90096311 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:14.265718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 932/1888] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:14.753661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b09c6f-0c1a-4436-88f5-47e40b25e837 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:14.756350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c4b09c6f-0c1a-4436-88f5-47e40b25e837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:14.776480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b09c6f-0c1a-4436-88f5-47e40b25e837 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:14.788429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:14.789337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:14.789622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:14.789928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] PATH_INFO: `/v3/projects/d76016047acb4418af74a1bea37457ba` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:14.796974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76016047acb4418af74a1bea37457ba)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:14.805356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:14.944986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76016047acb4418af74a1bea37457ba', 'request_id': 'req-0385013e-b644-48b8-8c02-6cbd7babbd25'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.002287 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba661e-dfc9-45c7-bbfd-2bda90096311 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:15.004319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2dba661e-dfc9-45c7-bbfd-2bda90096311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:15.019708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76016047acb4418af74a1bea37457ba', 'request_id': 'req-0385013e-b644-48b8-8c02-6cbd7babbd25'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.047593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76016047acb4418af74a1bea37457ba', 'request_id': 'req-0385013e-b644-48b8-8c02-6cbd7babbd25'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.047802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba661e-dfc9-45c7-bbfd-2bda90096311 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:15.065845 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] The token cache is being invalidate because project d76016047acb4418af74a1bea37457ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:15.066114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.066924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.072466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 957/1889] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:14 2022] DELETE /identity/v3/projects/d76016047acb4418af74a1bea37457ba => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:15.073502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:15.075050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:15.135538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:15.139468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:15.140724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:15.141023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:15.141302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] PATH_INFO: `/v3/projects/b5e484f65c8f4f9aa238c538146d087f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:15.143308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5e484f65c8f4f9aa238c538146d087f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:15.145417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:15.153185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385013e-b644-48b8-8c02-6cbd7babbd25 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:15.158114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:15.159375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:15.159830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:15.160260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] PATH_INFO: `/v3/users/59fbf58525914416a8a17d3813b56e2a` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:15.161721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fbf58525914416a8a17d3813b56e2a)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:15.163688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:15.289956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5e484f65c8f4f9aa238c538146d087f', 'request_id': 'req-c3e19de2-6544-40f1-bebd-2312614e070b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.296261 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:15.297246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5e484f65c8f4f9aa238c538146d087f', 'request_id': 'req-c3e19de2-6544-40f1-bebd-2312614e070b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.382464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fbf58525914416a8a17d3813b56e2a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.392240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5e484f65c8f4f9aa238c538146d087f', 'request_id': 'req-c3e19de2-6544-40f1-bebd-2312614e070b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.410462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fbf58525914416a8a17d3813b56e2a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.410623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] The token cache is being invalidate because project b5e484f65c8f4f9aa238c538146d087f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:15.411291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.412572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.415610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 933/1890] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:15 2022] DELETE /identity/v3/projects/b5e484f65c8f4f9aa238c538146d087f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:15.417483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:15.419327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:15.490931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fbf58525914416a8a17d3813b56e2a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.491561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fbf58525914416a8a17d3813b56e2a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.502276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fbf58525914416a8a17d3813b56e2a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.509505 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e19de2-6544-40f1-bebd-2312614e070b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:15.514348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 958/1891] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:15 2022] DELETE /identity/v3/users/59fbf58525914416a8a17d3813b56e2a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:15.515311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:15.518352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:15.533018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:15.534077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:15.534368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:15.534727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] PATH_INFO: `/v3/users/c07da5f3c8a043efba0b4d12f2763bb4` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:15.542946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07da5f3c8a043efba0b4d12f2763bb4)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:15.545135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:15.642456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e40f0b-c68a-420d-94d6-ceb56aef7802 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:15.648392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:15.649537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:15.650189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:15.651249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] PATH_INFO: `/v3/users/49fe03dbac174ff38334de43e4e6e800` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:15.652711 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fe03dbac174ff38334de43e4e6e800)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:15.654929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:15.823611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07da5f3c8a043efba0b4d12f2763bb4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.825508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07da5f3c8a043efba0b4d12f2763bb4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.855127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07da5f3c8a043efba0b4d12f2763bb4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.875476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07da5f3c8a043efba0b4d12f2763bb4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.882333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fe03dbac174ff38334de43e4e6e800'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.904819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fe03dbac174ff38334de43e4e6e800'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.909952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:15.945243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-123e5084-b9bc-46cd-ac36-1e0c3eb7c604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07da5f3c8a043efba0b4d12f2763bb4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:15.954628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 934/1892] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:15 2022] DELETE /identity/v3/users/c07da5f3c8a043efba0b4d12f2763bb4 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:15.958810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9da90-a86f-43c9-80eb-52dab7d14d67 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:15.959447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9da90-a86f-43c9-80eb-52dab7d14d67 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:15.959634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9da90-a86f-43c9-80eb-52dab7d14d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:15.982115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b2c9da90-a86f-43c9-80eb-52dab7d14d67 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:15.983688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b2c9da90-a86f-43c9-80eb-52dab7d14d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:16.002379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fe03dbac174ff38334de43e4e6e800'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:16.003096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fe03dbac174ff38334de43e4e6e800'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:16.021092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fe03dbac174ff38334de43e4e6e800'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:16.030817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 959/1893] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:15 2022] DELETE /identity/v3/users/49fe03dbac174ff38334de43e4e6e800 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:16.065998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 935/1894] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:16.085147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:16.086277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:16.188062 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5ba83-49ad-470b-9559-9ac4acaecb6c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:16.193154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56404eb-4d48-4bc2-86b9-ab098b03d6a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:16.194026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56404eb-4d48-4bc2-86b9-ab098b03d6a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:16.194765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56404eb-4d48-4bc2-86b9-ab098b03d6a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:16.195183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56404eb-4d48-4bc2-86b9-ab098b03d6a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:16.235868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9da90-a86f-43c9-80eb-52dab7d14d67 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:16.237942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b2c9da90-a86f-43c9-80eb-52dab7d14d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:16.270166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:16.280228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9da90-a86f-43c9-80eb-52dab7d14d67 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:16.289716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:16.289716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:16.289716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:16.289716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] PATH_INFO: `/v3/projects/82126097603c401c8198e9b14bb06851` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:16.301050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82126097603c401c8198e9b14bb06851)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:16.312184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:16.316661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56404eb-4d48-4bc2-86b9-ab098b03d6a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:16.322928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56404eb-4d48-4bc2-86b9-ab098b03d6a2 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:16.347580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 960/1895] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:16.480117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82126097603c401c8198e9b14bb06851', 'request_id': 'req-cbcdd18b-bd09-4d38-9531-c530ec4e312a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:16.523738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82126097603c401c8198e9b14bb06851', 'request_id': 'req-cbcdd18b-bd09-4d38-9531-c530ec4e312a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:16.621776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82126097603c401c8198e9b14bb06851', 'request_id': 'req-cbcdd18b-bd09-4d38-9531-c530ec4e312a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:16.641322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] The token cache is being invalidate because project 82126097603c401c8198e9b14bb06851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:16.641618 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:16.643754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cbcdd18b-bd09-4d38-9531-c530ec4e312a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:16.646232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 936/1896] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:16 2022] DELETE /identity/v3/projects/82126097603c401c8198e9b14bb06851 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:16.652073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06d12-71d7-4289-90eb-b5e3d528982d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:16.652372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06d12-71d7-4289-90eb-b5e3d528982d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:16.652730 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d06d12-71d7-4289-90eb-b5e3d528982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:16.680241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-85d06d12-71d7-4289-90eb-b5e3d528982d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:16.681593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-85d06d12-71d7-4289-90eb-b5e3d528982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:16.752166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 961/1897] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:16.760665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7bfc2-0030-4d91-b27b-248b3d53560b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:16.760958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7bfc2-0030-4d91-b27b-248b3d53560b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:16.761236 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7bfc2-0030-4d91-b27b-248b3d53560b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:16.787741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-06e7bfc2-0030-4d91-b27b-248b3d53560b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:16.789076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-06e7bfc2-0030-4d91-b27b-248b3d53560b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:16.801715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 937/1898] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:16.805842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06d12-71d7-4289-90eb-b5e3d528982d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:16.813705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7bfc2-0030-4d91-b27b-248b3d53560b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:16.815302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-06e7bfc2-0030-4d91-b27b-248b3d53560b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:16.828491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d06d12-71d7-4289-90eb-b5e3d528982d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:16.834598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9838f5-f91f-4eeb-9f86-df67331b190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:16.835226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7bfc2-0030-4d91-b27b-248b3d53560b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:16.835340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9838f5-f91f-4eeb-9f86-df67331b190b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:16.835669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9838f5-f91f-4eeb-9f86-df67331b190b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:16.836020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9838f5-f91f-4eeb-9f86-df67331b190b admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:16.836926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9838f5-f91f-4eeb-9f86-df67331b190b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:16.837335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9838f5-f91f-4eeb-9f86-df67331b190b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:16.839934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9838f5-f91f-4eeb-9f86-df67331b190b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:16.846397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:16.850997 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:16.851399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:16.851695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] PATH_INFO: `/v3/projects/4b2e99b5132a4c21a62c0e63ec77d468` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:16.855903 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2e99b5132a4c21a62c0e63ec77d468)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:16.859595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:16.865390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 962/1899] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:16.870563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9838f5-f91f-4eeb-9f86-df67331b190b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:16.882384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9838f5-f91f-4eeb-9f86-df67331b190b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:16.889225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672d5d5-267d-42e0-bb8f-d1ae73bbda8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:16.890199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672d5d5-267d-42e0-bb8f-d1ae73bbda8a admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:16.890494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672d5d5-267d-42e0-bb8f-d1ae73bbda8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:16.890772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672d5d5-267d-42e0-bb8f-d1ae73bbda8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:16.891948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672d5d5-267d-42e0-bb8f-d1ae73bbda8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:16.893882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672d5d5-267d-42e0-bb8f-d1ae73bbda8a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.011452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:17.021365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2e99b5132a4c21a62c0e63ec77d468', 'request_id': 'req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.023333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 963/1900] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:16 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:17.030099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2e99b5132a4c21a62c0e63ec77d468', 'request_id': 'req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.030231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672d5d5-267d-42e0-bb8f-d1ae73bbda8a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:17.100688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2e99b5132a4c21a62c0e63ec77d468', 'request_id': 'req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.116780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] The token cache is being invalidate because project 4b2e99b5132a4c21a62c0e63ec77d468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:17.117413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.118398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.121597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 938/1901] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:16 2022] DELETE /identity/v3/projects/4b2e99b5132a4c21a62c0e63ec77d468 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:17.123200 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:17.124861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.151222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672d5d5-267d-42e0-bb8f-d1ae73bbda8a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:17.156548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50590942-05a1-4d1f-a576-edcb7e071adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:17.159184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50590942-05a1-4d1f-a576-edcb7e071adb admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.159620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50590942-05a1-4d1f-a576-edcb7e071adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.159910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50590942-05a1-4d1f-a576-edcb7e071adb admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.160649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50590942-05a1-4d1f-a576-edcb7e071adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:17.163606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50590942-05a1-4d1f-a576-edcb7e071adb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.209390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af725a4-ced7-4a98-916f-bd9ec08ad3ca admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:17.214625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:17.216631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.216631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.216631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] PATH_INFO: `/v3/projects/812d84ac76f44eabab5511b435951bb2` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.217932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=812d84ac76f44eabab5511b435951bb2)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:17.220181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.227689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:17.271191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 964/1902] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:17 2022] POST /identity/v3/users => generated 283 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:17.272529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5a121-23cb-4e9f-aeff-85ec218af549 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.277819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5a121-23cb-4e9f-aeff-85ec218af549 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.277819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af5a121-23cb-4e9f-aeff-85ec218af549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.302935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8af5a121-23cb-4e9f-aeff-85ec218af549 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:17.302935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8af5a121-23cb-4e9f-aeff-85ec218af549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.308013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 965/1903] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:17.308853 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5a121-23cb-4e9f-aeff-85ec218af549 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:17.310249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8af5a121-23cb-4e9f-aeff-85ec218af549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.321855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af5a121-23cb-4e9f-aeff-85ec218af549 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:17.326802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ca54-a668-41aa-9406-a130e113094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:17.327716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ca54-a668-41aa-9406-a130e113094e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.327816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ca54-a668-41aa-9406-a130e113094e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.328068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ca54-a668-41aa-9406-a130e113094e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.328787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8ca54-a668-41aa-9406-a130e113094e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:17.330439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8ca54-a668-41aa-9406-a130e113094e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.340375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 966/1904] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:17.341526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aca3a-498c-4325-a82d-3c54a36aaec0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.341811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aca3a-498c-4325-a82d-3c54a36aaec0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.342086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16aca3a-498c-4325-a82d-3c54a36aaec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.361138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f16aca3a-498c-4325-a82d-3c54a36aaec0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:17.362347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f16aca3a-498c-4325-a82d-3c54a36aaec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.381597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '812d84ac76f44eabab5511b435951bb2', 'request_id': 'req-4af35d9d-a09d-442a-aa21-baab6f426e67'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.387379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '812d84ac76f44eabab5511b435951bb2', 'request_id': 'req-4af35d9d-a09d-442a-aa21-baab6f426e67'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.424460 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 967/1905] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:17.425367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16aca3a-498c-4325-a82d-3c54a36aaec0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:17.434352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16aca3a-498c-4325-a82d-3c54a36aaec0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:17.439047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e8a5-551d-4e81-bada-f901ba67112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:17.439629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e8a5-551d-4e81-bada-f901ba67112c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.439926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e8a5-551d-4e81-bada-f901ba67112c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.440221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e8a5-551d-4e81-bada-f901ba67112c admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.440935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e8a5-551d-4e81-bada-f901ba67112c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:17.442530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e8a5-551d-4e81-bada-f901ba67112c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.452918 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 968/1906] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:17.453692 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e8a5-551d-4e81-bada-f901ba67112c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:17.455369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0764e8a5-551d-4e81-bada-f901ba67112c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.468261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e8a5-551d-4e81-bada-f901ba67112c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:17.472917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:17.473758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.474047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.474326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] PATH_INFO: `/v3/users/7193035b7e334898a9d4566a8415ebef` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.475536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7193035b7e334898a9d4566a8415ebef)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:17.477414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.496308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '812d84ac76f44eabab5511b435951bb2', 'request_id': 'req-4af35d9d-a09d-442a-aa21-baab6f426e67'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.507989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] The token cache is being invalidate because project 812d84ac76f44eabab5511b435951bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:17.508284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.508951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.511116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 939/1907] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:17 2022] DELETE /identity/v3/projects/812d84ac76f44eabab5511b435951bb2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:17.511896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:17.513514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.526190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af35d9d-a09d-442a-aa21-baab6f426e67 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:17.530893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:17.531542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.531836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.532123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.532878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:17.533192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:17.534780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.546007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 940/1908] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:17.546758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:17.548338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.561311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f84776-db26-4ad6-8435-7c03cdc8e744 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:17.566076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e63e-8107-43f3-9599-c2aadb8155b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:17.566964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e63e-8107-43f3-9599-c2aadb8155b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.567254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e63e-8107-43f3-9599-c2aadb8155b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.567535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e63e-8107-43f3-9599-c2aadb8155b4 admin admin] PATH_INFO: `/v3/projects/88c7d24340184bc7ad9ba9c3413c470f/users/45fc71caba6b422d96a63f7c3a6f6d24/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.584116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41e63e-8107-43f3-9599-c2aadb8155b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c7d24340184bc7ad9ba9c3413c470f, user_id=45fc71caba6b422d96a63f7c3a6f6d24, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:17.586978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41e63e-8107-43f3-9599-c2aadb8155b4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.630035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7193035b7e334898a9d4566a8415ebef'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.642687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7193035b7e334898a9d4566a8415ebef'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.651444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 941/1909] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:17 2022] PUT /identity/v3/projects/88c7d24340184bc7ad9ba9c3413c470f/users/45fc71caba6b422d96a63f7c3a6f6d24/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:17.659107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b67b8-e87a-467f-ba7a-6438e7187e05 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.659107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b67b8-e87a-467f-ba7a-6438e7187e05 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.659107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b67b8-e87a-467f-ba7a-6438e7187e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.670764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-834b67b8-e87a-467f-ba7a-6438e7187e05 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:17.672002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-834b67b8-e87a-467f-ba7a-6438e7187e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.730250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7193035b7e334898a9d4566a8415ebef'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.730988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7193035b7e334898a9d4566a8415ebef'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.733368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 942/1910] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:17.735837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b67b8-e87a-467f-ba7a-6438e7187e05 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:17.738796 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f7aa7ccc-5915-468f-b2b3-ff15d8ac85e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7193035b7e334898a9d4566a8415ebef'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:17.745794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b67b8-e87a-467f-ba7a-6438e7187e05 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:17.746125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 969/1911] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:17 2022] DELETE /identity/v3/users/7193035b7e334898a9d4566a8415ebef => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:17.747487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba15a-f1e5-4832-a5da-d13f1c1e48ce None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.747891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba15a-f1e5-4832-a5da-d13f1c1e48ce None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.748168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ba15a-f1e5-4832-a5da-d13f1c1e48ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.782746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b10ba15a-f1e5-4832-a5da-d13f1c1e48ce None None] MFA Rules not processed for user `45fc71caba6b422d96a63f7c3a6f6d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:17.784136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b10ba15a-f1e5-4832-a5da-d13f1c1e48ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.866744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 970/1912] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:17.868219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054515-245c-455d-95e3-dd6f8b020eb4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.868511 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054515-245c-455d-95e3-dd6f8b020eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.868790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054515-245c-455d-95e3-dd6f8b020eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.889577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-31054515-245c-455d-95e3-dd6f8b020eb4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:17.890861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-31054515-245c-455d-95e3-dd6f8b020eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.938341 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7cfb0-c9ef-4168-9980-a6c2ff01efe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:17.939102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7cfb0-c9ef-4168-9980-a6c2ff01efe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.939395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7cfb0-c9ef-4168-9980-a6c2ff01efe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.939695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7cfb0-c9ef-4168-9980-a6c2ff01efe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.940462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7cfb0-c9ef-4168-9980-a6c2ff01efe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:17.942394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7cfb0-c9ef-4168-9980-a6c2ff01efe6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.957956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 971/1913] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:17.959056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054515-245c-455d-95e3-dd6f8b020eb4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:17.960299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-31054515-245c-455d-95e3-dd6f8b020eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:17.971627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054515-245c-455d-95e3-dd6f8b020eb4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:17.976567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c34df-6660-4702-ae65-650f0137edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:17.977251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c34df-6660-4702-ae65-650f0137edb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:17.977539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c34df-6660-4702-ae65-650f0137edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:17.977821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c34df-6660-4702-ae65-650f0137edb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:17.979203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c34df-6660-4702-ae65-650f0137edb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:17.981233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c34df-6660-4702-ae65-650f0137edb0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:17.984249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:18.050453 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 943/1914] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:17 2022] POST /identity/v3/projects => generated 373 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:18.050453 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7cfb0-c9ef-4168-9980-a6c2ff01efe6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.102115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:18.110084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 972/1915] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:17 2022] POST /identity/v3/projects => generated 363 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:18.110801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c34df-6660-4702-ae65-650f0137edb0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.112423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-178c34df-6660-4702-ae65-650f0137edb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:18.115299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7cfb0-c9ef-4168-9980-a6c2ff01efe6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.172431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.173103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.173389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.173666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.174455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:18.174769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.176457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.178442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c34df-6660-4702-ae65-650f0137edb0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.183812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.184684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.184968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.185247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] PATH_INFO: `/v3/projects/60cadfa1afa64784b6fc101c913ad40b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.186434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cadfa1afa64784b6fc101c913ad40b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.188377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.189235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 944/1916] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:18.189875 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.195297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:18.208182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26758f-09d4-45ed-9a75-9e9421118bd0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.213721 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdbf70-da96-4c75-8e07-5e10e6c17b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.214596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdbf70-da96-4c75-8e07-5e10e6c17b8a admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.214926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdbf70-da96-4c75-8e07-5e10e6c17b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.215495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdbf70-da96-4c75-8e07-5e10e6c17b8a admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.216438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdbf70-da96-4c75-8e07-5e10e6c17b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.218810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbdbf70-da96-4c75-8e07-5e10e6c17b8a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.307881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 945/1917] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:18 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:18.308703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdbf70-da96-4c75-8e07-5e10e6c17b8a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.326594 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbdbf70-da96-4c75-8e07-5e10e6c17b8a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.330237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cadfa1afa64784b6fc101c913ad40b', 'request_id': 'req-97ba7800-a78f-4c30-bc57-e4845682ee9a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:18.375209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:18.399552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2eb1e-e7dd-4965-957b-a3aca2e0769f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.400815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2eb1e-e7dd-4965-957b-a3aca2e0769f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.401553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2eb1e-e7dd-4965-957b-a3aca2e0769f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.402426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2eb1e-e7dd-4965-957b-a3aca2e0769f admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.402766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cadfa1afa64784b6fc101c913ad40b', 'request_id': 'req-97ba7800-a78f-4c30-bc57-e4845682ee9a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:18.403166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2eb1e-e7dd-4965-957b-a3aca2e0769f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.405203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2eb1e-e7dd-4965-957b-a3aca2e0769f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.411102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cadfa1afa64784b6fc101c913ad40b', 'request_id': 'req-97ba7800-a78f-4c30-bc57-e4845682ee9a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:18.418078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:18.424554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] The token cache is being invalidate because project 60cadfa1afa64784b6fc101c913ad40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:18.424955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:18.425889 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:18.427561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 973/1918] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:18 2022] DELETE /identity/v3/projects/60cadfa1afa64784b6fc101c913ad40b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:18.428375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.432670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:18.445046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba7800-a78f-4c30-bc57-e4845682ee9a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.450541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9231b6e-820b-4160-9b75-3cdc41fda7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.451214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9231b6e-820b-4160-9b75-3cdc41fda7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.451503 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9231b6e-820b-4160-9b75-3cdc41fda7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.451781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9231b6e-820b-4160-9b75-3cdc41fda7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.452467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9231b6e-820b-4160-9b75-3cdc41fda7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.454348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9231b6e-820b-4160-9b75-3cdc41fda7f8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.505358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 946/1919] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:18 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:18.506252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2eb1e-e7dd-4965-957b-a3aca2e0769f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.507873 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-12e2eb1e-e7dd-4965-957b-a3aca2e0769f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:18.520560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2eb1e-e7dd-4965-957b-a3aca2e0769f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.525355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee89a21-53a2-48dd-a7c3-4e50a78821bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.526188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee89a21-53a2-48dd-a7c3-4e50a78821bb admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.526308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee89a21-53a2-48dd-a7c3-4e50a78821bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.526570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee89a21-53a2-48dd-a7c3-4e50a78821bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.527334 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee89a21-53a2-48dd-a7c3-4e50a78821bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.528928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee89a21-53a2-48dd-a7c3-4e50a78821bb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.541683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 947/1920] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:18.541683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e2d41-1509-4c62-9c84-155818c203d0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.541683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e2d41-1509-4c62-9c84-155818c203d0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.541683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e2d41-1509-4c62-9c84-155818c203d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.558562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-508e2d41-1509-4c62-9c84-155818c203d0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:18.559778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-508e2d41-1509-4c62-9c84-155818c203d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:18.568136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 948/1921] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:18.568882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e2d41-1509-4c62-9c84-155818c203d0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.570084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-508e2d41-1509-4c62-9c84-155818c203d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:18.583376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e2d41-1509-4c62-9c84-155818c203d0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.589192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbf15c-a5bf-4e51-840e-5a28c54da5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.589858 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbf15c-a5bf-4e51-840e-5a28c54da5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.590140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbf15c-a5bf-4e51-840e-5a28c54da5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.590414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbf15c-a5bf-4e51-840e-5a28c54da5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.591169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbf15c-a5bf-4e51-840e-5a28c54da5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.593044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbf15c-a5bf-4e51-840e-5a28c54da5f7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.606671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 974/1922] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:18 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:18.606671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9231b6e-820b-4160-9b75-3cdc41fda7f8 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.606977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 949/1923] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:18.606977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5eb84-4efd-4ddb-84dd-c06569288a79 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.606977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5eb84-4efd-4ddb-84dd-c06569288a79 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.607219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d5eb84-4efd-4ddb-84dd-c06569288a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.625692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-67d5eb84-4efd-4ddb-84dd-c06569288a79 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:18.627089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-67d5eb84-4efd-4ddb-84dd-c06569288a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:18.670578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9231b6e-820b-4160-9b75-3cdc41fda7f8 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.676461 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650d4df-15db-4875-80e7-2267f2e31254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.677127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650d4df-15db-4875-80e7-2267f2e31254 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.677658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650d4df-15db-4875-80e7-2267f2e31254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.677658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650d4df-15db-4875-80e7-2267f2e31254 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.678387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650d4df-15db-4875-80e7-2267f2e31254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.680033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650d4df-15db-4875-80e7-2267f2e31254 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.689006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 950/1924] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:18.689855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5eb84-4efd-4ddb-84dd-c06569288a79 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.693205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 975/1925] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:18.693205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650d4df-15db-4875-80e7-2267f2e31254 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.701644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d5eb84-4efd-4ddb-84dd-c06569288a79 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.703400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650d4df-15db-4875-80e7-2267f2e31254 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.706318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaa4fa-3619-4251-9145-845f4acf3516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.707003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa4fa-3619-4251-9145-845f4acf3516 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.707285 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa4fa-3619-4251-9145-845f4acf3516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.707557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaa4fa-3619-4251-9145-845f4acf3516 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.708068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee814c-f42d-4283-a25d-f10f9742dea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.708237 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaa4fa-3619-4251-9145-845f4acf3516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.708936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee814c-f42d-4283-a25d-f10f9742dea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.709217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee814c-f42d-4283-a25d-f10f9742dea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.709489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee814c-f42d-4283-a25d-f10f9742dea7 admin admin] PATH_INFO: `/v3/projects/8daf2431c8c147238828652ed39bbd3b/users/d84ca56183e948eaae4170267217ca0f/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.710141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaa4fa-3619-4251-9145-845f4acf3516 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.725033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee814c-f42d-4283-a25d-f10f9742dea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8daf2431c8c147238828652ed39bbd3b, user_id=d84ca56183e948eaae4170267217ca0f, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.727729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee814c-f42d-4283-a25d-f10f9742dea7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.818980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 951/1926] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:18 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:18.819892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaa4fa-3619-4251-9145-845f4acf3516 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.830083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaa4fa-3619-4251-9145-845f4acf3516 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.834737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d7ea0-ffc4-4ae0-a14a-121651e04c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.835447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d7ea0-ffc4-4ae0-a14a-121651e04c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.835734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d7ea0-ffc4-4ae0-a14a-121651e04c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.836012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d7ea0-ffc4-4ae0-a14a-121651e04c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.836730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d7ea0-ffc4-4ae0-a14a-121651e04c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:18.837039 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d7ea0-ffc4-4ae0-a14a-121651e04c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.839340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d7ea0-ffc4-4ae0-a14a-121651e04c25 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.847922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 976/1927] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:18 2022] PUT /identity/v3/projects/8daf2431c8c147238828652ed39bbd3b/users/d84ca56183e948eaae4170267217ca0f/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:18.848734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee814c-f42d-4283-a25d-f10f9742dea7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.855319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 952/1928] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:18.856259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d7ea0-ffc4-4ae0-a14a-121651e04c25 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.866028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d7ea0-ffc4-4ae0-a14a-121651e04c25 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.875480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:18.914750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee814c-f42d-4283-a25d-f10f9742dea7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.920232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d96aee-1d30-4028-bc8e-af8b42d57918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.921126 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d96aee-1d30-4028-bc8e-af8b42d57918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.921448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d96aee-1d30-4028-bc8e-af8b42d57918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.921733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d96aee-1d30-4028-bc8e-af8b42d57918 admin admin] PATH_INFO: `/v3/projects/ed18f00663a44f87ac804f32cb090347/users/57a55db0840e4c62be81de24a1ceed8c/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.923337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6836c7-ad4e-4b93-ad9c-648c4f60f73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.924000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6836c7-ad4e-4b93-ad9c-648c4f60f73c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.924284 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6836c7-ad4e-4b93-ad9c-648c4f60f73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.924560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6836c7-ad4e-4b93-ad9c-648c4f60f73c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.925297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6836c7-ad4e-4b93-ad9c-648c4f60f73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.926915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6836c7-ad4e-4b93-ad9c-648c4f60f73c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.937150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 953/1929] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:18.937958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6836c7-ad4e-4b93-ad9c-648c4f60f73c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.938324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d96aee-1d30-4028-bc8e-af8b42d57918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed18f00663a44f87ac804f32cb090347, user_id=57a55db0840e4c62be81de24a1ceed8c, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.941308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d96aee-1d30-4028-bc8e-af8b42d57918 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.948321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6836c7-ad4e-4b93-ad9c-648c4f60f73c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.953021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aed6c-9400-4bcd-a95c-569ed3dbc12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.958169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aed6c-9400-4bcd-a95c-569ed3dbc12a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.958169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aed6c-9400-4bcd-a95c-569ed3dbc12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.958169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aed6c-9400-4bcd-a95c-569ed3dbc12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.958169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aed6c-9400-4bcd-a95c-569ed3dbc12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.958169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aed6c-9400-4bcd-a95c-569ed3dbc12a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:18.967179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 954/1930] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:18.968083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aed6c-9400-4bcd-a95c-569ed3dbc12a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:18.977475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aed6c-9400-4bcd-a95c-569ed3dbc12a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:18.982189 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b528-ef57-4be6-84b3-9c53df5b8ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:18.982806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b528-ef57-4be6-84b3-9c53df5b8ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:18.983151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b528-ef57-4be6-84b3-9c53df5b8ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:18.983433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b528-ef57-4be6-84b3-9c53df5b8ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:18.984104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b528-ef57-4be6-84b3-9c53df5b8ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:18.985971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b528-ef57-4be6-84b3-9c53df5b8ccc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.002328 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 977/1931] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:18 2022] PUT /identity/v3/projects/ed18f00663a44f87ac804f32cb090347/users/57a55db0840e4c62be81de24a1ceed8c/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:19.003198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d96aee-1d30-4028-bc8e-af8b42d57918 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.066634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d96aee-1d30-4028-bc8e-af8b42d57918 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.071445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453a03c-d40b-4373-b3db-0df3b394862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.072053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a03c-d40b-4373-b3db-0df3b394862c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.073001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a03c-d40b-4373-b3db-0df3b394862c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.073291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453a03c-d40b-4373-b3db-0df3b394862c admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.074060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453a03c-d40b-4373-b3db-0df3b394862c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.075714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453a03c-d40b-4373-b3db-0df3b394862c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.077529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:19.083611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 955/1932] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:18 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:19.084411 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b528-ef57-4be6-84b3-9c53df5b8ccc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.089053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 978/1933] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:19.090401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd0e9-d207-4443-842d-d7fc6ba81832 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.090697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd0e9-d207-4443-842d-d7fc6ba81832 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.091012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd0e9-d207-4443-842d-d7fc6ba81832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.117495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-974dd0e9-d207-4443-842d-d7fc6ba81832 None None] MFA Rules not processed for user `57a55db0840e4c62be81de24a1ceed8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:19.118705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-974dd0e9-d207-4443-842d-d7fc6ba81832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:19.155649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b528-ef57-4be6-84b3-9c53df5b8ccc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.161132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa6782-d6b6-44a8-8c5c-9287370faab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.162018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa6782-d6b6-44a8-8c5c-9287370faab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.162300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa6782-d6b6-44a8-8c5c-9287370faab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.162573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa6782-d6b6-44a8-8c5c-9287370faab7 admin admin] PATH_INFO: `/v3/projects/8daf2431c8c147238828652ed39bbd3b/users/d84ca56183e948eaae4170267217ca0f/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.164566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa6782-d6b6-44a8-8c5c-9287370faab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8daf2431c8c147238828652ed39bbd3b, user_id=d84ca56183e948eaae4170267217ca0f, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.167573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa6782-d6b6-44a8-8c5c-9287370faab7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.177973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 956/1934] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:19 2022] PUT /identity/v3/projects/8daf2431c8c147238828652ed39bbd3b/users/d84ca56183e948eaae4170267217ca0f/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:19.179615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa6782-d6b6-44a8-8c5c-9287370faab7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.184982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 979/1935] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:19.188122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd0e9-d207-4443-842d-d7fc6ba81832 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.200959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd0e9-d207-4443-842d-d7fc6ba81832 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.230544 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:19.245870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa6782-d6b6-44a8-8c5c-9287370faab7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.250668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017af9c-96ff-47dc-8f96-9b7d5750b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.251361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017af9c-96ff-47dc-8f96-9b7d5750b8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.251641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017af9c-96ff-47dc-8f96-9b7d5750b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.251969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017af9c-96ff-47dc-8f96-9b7d5750b8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.252695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017af9c-96ff-47dc-8f96-9b7d5750b8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.255322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017af9c-96ff-47dc-8f96-9b7d5750b8b4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.257548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75567af-d63c-4c5c-bab8-2a5a178d2920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.258445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75567af-d63c-4c5c-bab8-2a5a178d2920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.258731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75567af-d63c-4c5c-bab8-2a5a178d2920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.259049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75567af-d63c-4c5c-bab8-2a5a178d2920 admin admin] PATH_INFO: `/v3/projects/d772160869694a658955329242565c46/users/30bf05081df24fe7b9098ca72bf99585/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.274763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75567af-d63c-4c5c-bab8-2a5a178d2920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d772160869694a658955329242565c46, user_id=30bf05081df24fe7b9098ca72bf99585, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.277780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75567af-d63c-4c5c-bab8-2a5a178d2920 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.347718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 957/1936] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:19 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:19.349085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220ab4f-ec5b-415d-8421-9b1ec44ae7d4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.349381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220ab4f-ec5b-415d-8421-9b1ec44ae7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.349670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220ab4f-ec5b-415d-8421-9b1ec44ae7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.376983 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3220ab4f-ec5b-415d-8421-9b1ec44ae7d4 None None] MFA Rules not processed for user `d84ca56183e948eaae4170267217ca0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:19.378190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3220ab4f-ec5b-415d-8421-9b1ec44ae7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:19.378551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 980/1937] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:19 2022] PUT /identity/v3/projects/d772160869694a658955329242565c46/users/30bf05081df24fe7b9098ca72bf99585/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:19.379445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75567af-d63c-4c5c-bab8-2a5a178d2920 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.388924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d75567af-d63c-4c5c-bab8-2a5a178d2920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:19.448708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75567af-d63c-4c5c-bab8-2a5a178d2920 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.453296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1a19c-c00c-4584-9504-7615c5b7506b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.454017 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1a19c-c00c-4584-9504-7615c5b7506b service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.454307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1a19c-c00c-4584-9504-7615c5b7506b service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.454584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1a19c-c00c-4584-9504-7615c5b7506b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.457789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 958/1938] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:19.458692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220ab4f-ec5b-415d-8421-9b1ec44ae7d4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.471311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:19.523655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1a19c-c00c-4584-9504-7615c5b7506b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.525497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1a19c-c00c-4584-9504-7615c5b7506b service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.534179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220ab4f-ec5b-415d-8421-9b1ec44ae7d4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.536645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 981/1939] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:19.538331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33328024-7980-4b7d-9b86-7e7b7047b41d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.538627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33328024-7980-4b7d-9b86-7e7b7047b41d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.540197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33328024-7980-4b7d-9b86-7e7b7047b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.557409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687470-49e3-410a-8aae-57bd66113144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.557409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687470-49e3-410a-8aae-57bd66113144 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.557409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687470-49e3-410a-8aae-57bd66113144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.557409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687470-49e3-410a-8aae-57bd66113144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.569559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687470-49e3-410a-8aae-57bd66113144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.569559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687470-49e3-410a-8aae-57bd66113144 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.569559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 959/1940] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:19.570133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687470-49e3-410a-8aae-57bd66113144 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.573434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ec687470-49e3-410a-8aae-57bd66113144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:19.579733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-33328024-7980-4b7d-9b86-7e7b7047b41d None None] MFA Rules not processed for user `30bf05081df24fe7b9098ca72bf99585`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:19.581051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-33328024-7980-4b7d-9b86-7e7b7047b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:19.593554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687470-49e3-410a-8aae-57bd66113144 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.597592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef09b6b-05ef-49b4-bd45-6a1443027f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.598544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef09b6b-05ef-49b4-bd45-6a1443027f7d service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.598965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef09b6b-05ef-49b4-bd45-6a1443027f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.599261 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef09b6b-05ef-49b4-bd45-6a1443027f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.610450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef09b6b-05ef-49b4-bd45-6a1443027f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.611909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef09b6b-05ef-49b4-bd45-6a1443027f7d service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.626962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 960/1941] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:19.627802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef09b6b-05ef-49b4-bd45-6a1443027f7d service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.638545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef09b6b-05ef-49b4-bd45-6a1443027f7d service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.643155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.644022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.644323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.644581 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] PATH_INFO: `/v3/users/57a55db0840e4c62be81de24a1ceed8c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.646153 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a55db0840e4c62be81de24a1ceed8c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.648102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.649207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:19.654568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 982/1942] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:19.655428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33328024-7980-4b7d-9b86-7e7b7047b41d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.665761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33328024-7980-4b7d-9b86-7e7b7047b41d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.671281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d1e36-7986-416b-9bd3-3b89ff7b04eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.672068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d1e36-7986-416b-9bd3-3b89ff7b04eb admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.672423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d1e36-7986-416b-9bd3-3b89ff7b04eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.672775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d1e36-7986-416b-9bd3-3b89ff7b04eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.673597 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d1e36-7986-416b-9bd3-3b89ff7b04eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.675227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d1e36-7986-416b-9bd3-3b89ff7b04eb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.685852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 983/1943] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:19.686618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d1e36-7986-416b-9bd3-3b89ff7b04eb admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.696072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d1e36-7986-416b-9bd3-3b89ff7b04eb admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.700876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efef625-915e-46f4-8eb5-bcda0096a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.701484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef625-915e-46f4-8eb5-bcda0096a2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.701776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef625-915e-46f4-8eb5-bcda0096a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.702064 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efef625-915e-46f4-8eb5-bcda0096a2c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.702734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efef625-915e-46f4-8eb5-bcda0096a2c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.704614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efef625-915e-46f4-8eb5-bcda0096a2c4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.817788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 984/1944] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:19 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:19.818613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efef625-915e-46f4-8eb5-bcda0096a2c4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.849426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a55db0840e4c62be81de24a1ceed8c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:19.850359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a55db0840e4c62be81de24a1ceed8c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:19.864463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a55db0840e4c62be81de24a1ceed8c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:19.871850 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a55db0840e4c62be81de24a1ceed8c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:19.885577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efef625-915e-46f4-8eb5-bcda0096a2c4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:19.890983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb7dd7-dc2e-47de-8c16-12375b86ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:19.891883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb7dd7-dc2e-47de-8c16-12375b86ffce admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:19.892173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb7dd7-dc2e-47de-8c16-12375b86ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:19.892452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb7dd7-dc2e-47de-8c16-12375b86ffce admin admin] PATH_INFO: `/v3/projects/244c1110cf294e4db84cfd634176a050/users/d5ecc7f3d2ff4d2b873f274af38746b5/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:19.924763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb7dd7-dc2e-47de-8c16-12375b86ffce admin admin] RBAC: Authorizing `identity:create_grant(project_id=244c1110cf294e4db84cfd634176a050, user_id=d5ecc7f3d2ff4d2b873f274af38746b5, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:19.924763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb7dd7-dc2e-47de-8c16-12375b86ffce admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:19.944677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a55db0840e4c62be81de24a1ceed8c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:19.951512 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 961/1945] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:19 2022] DELETE /identity/v3/users/57a55db0840e4c62be81de24a1ceed8c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:19.954575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:19.954575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:20.002387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 985/1946] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:19 2022] PUT /identity/v3/projects/244c1110cf294e4db84cfd634176a050/users/d5ecc7f3d2ff4d2b873f274af38746b5/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:20.003826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c41a28-b19c-48a7-aead-25a17a79584c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.004121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c41a28-b19c-48a7-aead-25a17a79584c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.004399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c41a28-b19c-48a7-aead-25a17a79584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.021172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-21c41a28-b19c-48a7-aead-25a17a79584c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:20.022367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-21c41a28-b19c-48a7-aead-25a17a79584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:20.033742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc2e2af-109b-43e6-b1bc-e53813b67e92 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.037535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:20.099630 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026961e-1134-4a28-a0de-623e082fbdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.100227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026961e-1134-4a28-a0de-623e082fbdeb admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.100511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026961e-1134-4a28-a0de-623e082fbdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.100788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026961e-1134-4a28-a0de-623e082fbdeb admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.101502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026961e-1134-4a28-a0de-623e082fbdeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.102283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 986/1947] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:20.104114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026961e-1134-4a28-a0de-623e082fbdeb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.104427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f501e7d-6dd0-408f-95a8-51530ab06fcc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.104981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f501e7d-6dd0-408f-95a8-51530ab06fcc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.105264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f501e7d-6dd0-408f-95a8-51530ab06fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.131457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1f501e7d-6dd0-408f-95a8-51530ab06fcc None None] MFA Rules not processed for user `d5ecc7f3d2ff4d2b873f274af38746b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:20.132646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1f501e7d-6dd0-408f-95a8-51530ab06fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:20.172435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:20.198912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 987/1948] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:20.199803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f501e7d-6dd0-408f-95a8-51530ab06fcc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.201105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1f501e7d-6dd0-408f-95a8-51530ab06fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:20.217258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 962/1949] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:19 2022] POST /identity/v3/users => generated 292 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:20.218083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026961e-1134-4a28-a0de-623e082fbdeb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.219920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4026961e-1134-4a28-a0de-623e082fbdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:20.231604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026961e-1134-4a28-a0de-623e082fbdeb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.236313 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd42854-d95b-40c6-a591-0a1b9fe54929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.241825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd42854-d95b-40c6-a591-0a1b9fe54929 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.241825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd42854-d95b-40c6-a591-0a1b9fe54929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.241825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd42854-d95b-40c6-a591-0a1b9fe54929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.241825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd42854-d95b-40c6-a591-0a1b9fe54929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.241825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd42854-d95b-40c6-a591-0a1b9fe54929 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.258962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f501e7d-6dd0-408f-95a8-51530ab06fcc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.266356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51e618-d472-4ebc-8f68-76066b1051b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.266356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e618-d472-4ebc-8f68-76066b1051b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.266356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e618-d472-4ebc-8f68-76066b1051b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.266356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e618-d472-4ebc-8f68-76066b1051b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.274811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51e618-d472-4ebc-8f68-76066b1051b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.277026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51e618-d472-4ebc-8f68-76066b1051b6 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.286761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 988/1950] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:20.287655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51e618-d472-4ebc-8f68-76066b1051b6 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.298099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51e618-d472-4ebc-8f68-76066b1051b6 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.303076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f325-4009-4dc4-85b8-577605b18d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.303774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f325-4009-4dc4-85b8-577605b18d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.304065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f325-4009-4dc4-85b8-577605b18d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.304449 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040f325-4009-4dc4-85b8-577605b18d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.305102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f325-4009-4dc4-85b8-577605b18d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.306762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040f325-4009-4dc4-85b8-577605b18d7d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.318144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 989/1951] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:20.321996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f325-4009-4dc4-85b8-577605b18d7d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.328009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 963/1952] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:20 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:20.332919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd42854-d95b-40c6-a591-0a1b9fe54929 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.339238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040f325-4009-4dc4-85b8-577605b18d7d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.413449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd42854-d95b-40c6-a591-0a1b9fe54929 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.422250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc3af8-b392-4f13-8060-04d1fe7dd47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.423114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc3af8-b392-4f13-8060-04d1fe7dd47c admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.423378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173c4be-10d5-4b89-9787-ecf9005e9e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.423513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc3af8-b392-4f13-8060-04d1fe7dd47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.423859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc3af8-b392-4f13-8060-04d1fe7dd47c admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.424416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173c4be-10d5-4b89-9787-ecf9005e9e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.424663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc3af8-b392-4f13-8060-04d1fe7dd47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.424841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173c4be-10d5-4b89-9787-ecf9005e9e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.425192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173c4be-10d5-4b89-9787-ecf9005e9e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.426145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173c4be-10d5-4b89-9787-ecf9005e9e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.426943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc3af8-b392-4f13-8060-04d1fe7dd47c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.427992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173c4be-10d5-4b89-9787-ecf9005e9e4b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.440487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 990/1953] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:20.444718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173c4be-10d5-4b89-9787-ecf9005e9e4b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.455774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173c4be-10d5-4b89-9787-ecf9005e9e4b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.460731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c74508-f436-4ebb-9db8-bd0b17fa3a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.461644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c74508-f436-4ebb-9db8-bd0b17fa3a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.461936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c74508-f436-4ebb-9db8-bd0b17fa3a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.462220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c74508-f436-4ebb-9db8-bd0b17fa3a84 admin admin] PATH_INFO: `/v3/projects/a8817dedfbef42138671178aa20908eb/users/2f49d554860b40379fe9ed830a6ad3c0/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.479770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c74508-f436-4ebb-9db8-bd0b17fa3a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8817dedfbef42138671178aa20908eb, user_id=2f49d554860b40379fe9ed830a6ad3c0, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.482617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c74508-f436-4ebb-9db8-bd0b17fa3a84 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.557548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 964/1954] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:20 2022] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:20.561608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc3af8-b392-4f13-8060-04d1fe7dd47c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.573850 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc3af8-b392-4f13-8060-04d1fe7dd47c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.578520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 991/1955] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:20 2022] PUT /identity/v3/projects/a8817dedfbef42138671178aa20908eb/users/2f49d554860b40379fe9ed830a6ad3c0/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:20.594104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f471-fefc-48ec-8083-4983ab442fed None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.594104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f471-fefc-48ec-8083-4983ab442fed None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.594104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f471-fefc-48ec-8083-4983ab442fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.619685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ea95f471-fefc-48ec-8083-4983ab442fed None None] MFA Rules not processed for user `2f49d554860b40379fe9ed830a6ad3c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:20.621010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ea95f471-fefc-48ec-8083-4983ab442fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:20.659616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:20.671465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1acda-8540-492d-97c8-372ee7a42979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.672151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1acda-8540-492d-97c8-372ee7a42979 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.672440 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1acda-8540-492d-97c8-372ee7a42979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.672722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1acda-8540-492d-97c8-372ee7a42979 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.673493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1acda-8540-492d-97c8-372ee7a42979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.675167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1acda-8540-492d-97c8-372ee7a42979 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.686536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 965/1956] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:20.688713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1acda-8540-492d-97c8-372ee7a42979 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.688713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bbc1acda-8540-492d-97c8-372ee7a42979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:20.698289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:20.702225 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1acda-8540-492d-97c8-372ee7a42979 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.703379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 992/1957] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:20.704105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95f471-fefc-48ec-8083-4983ab442fed None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.707666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.708553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.709515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.709515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] PATH_INFO: `/v3/users/45fc71caba6b422d96a63f7c3a6f6d24` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.710578 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fc71caba6b422d96a63f7c3a6f6d24)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.712573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.718617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95f471-fefc-48ec-8083-4983ab442fed None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.723806 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554058b-c262-4b67-9ce1-226ee060775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.724805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554058b-c262-4b67-9ce1-226ee060775f admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.725173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554058b-c262-4b67-9ce1-226ee060775f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.725834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5554058b-c262-4b67-9ce1-226ee060775f admin admin] PATH_INFO: `/v3/projects/5c909735438f471b8f9cf421da5a5193/users/6c391a99e9d74cd1867f29b1dbe811a4/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.745284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554058b-c262-4b67-9ce1-226ee060775f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c909735438f471b8f9cf421da5a5193, user_id=6c391a99e9d74cd1867f29b1dbe811a4, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.748751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5554058b-c262-4b67-9ce1-226ee060775f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.845863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 993/1958] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:20 2022] PUT /identity/v3/projects/5c909735438f471b8f9cf421da5a5193/users/6c391a99e9d74cd1867f29b1dbe811a4/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:20.846791 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554058b-c262-4b67-9ce1-226ee060775f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:20.913140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5554058b-c262-4b67-9ce1-226ee060775f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:20.918124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778858bb-14a7-4cc9-9d71-eab1d61c97d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:20.918792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778858bb-14a7-4cc9-9d71-eab1d61c97d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:20.920930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778858bb-14a7-4cc9-9d71-eab1d61c97d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:20.920930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778858bb-14a7-4cc9-9d71-eab1d61c97d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:20.920930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778858bb-14a7-4cc9-9d71-eab1d61c97d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:20.922097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778858bb-14a7-4cc9-9d71-eab1d61c97d9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:20.930342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fc71caba6b422d96a63f7c3a6f6d24'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:20.931145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fc71caba6b422d96a63f7c3a6f6d24'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:20.944389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fc71caba6b422d96a63f7c3a6f6d24'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:20.951963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fc71caba6b422d96a63f7c3a6f6d24'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:21.050071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fc71caba6b422d96a63f7c3a6f6d24'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:21.056910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 966/1959] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:20 2022] DELETE /identity/v3/users/45fc71caba6b422d96a63f7c3a6f6d24 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:21.060640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 994/1960] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:20 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:21.061092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.061184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778858bb-14a7-4cc9-9d71-eab1d61c97d9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.061184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-778858bb-14a7-4cc9-9d71-eab1d61c97d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.061869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.124433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778858bb-14a7-4cc9-9d71-eab1d61c97d9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.127385 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391a2b3-f959-4b0a-91b8-dc3d053c583c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.129093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.129964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.130252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.130530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] PATH_INFO: `/v3/projects/ed18f00663a44f87ac804f32cb090347` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.131837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed18f00663a44f87ac804f32cb090347)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.132005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8270ace6-1462-4c36-ba55-dfef042ac842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.132668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270ace6-1462-4c36-ba55-dfef042ac842 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.132956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270ace6-1462-4c36-ba55-dfef042ac842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.133234 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8270ace6-1462-4c36-ba55-dfef042ac842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.133747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.133965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270ace6-1462-4c36-ba55-dfef042ac842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.136079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8270ace6-1462-4c36-ba55-dfef042ac842 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.146162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 967/1961] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:21.147415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8761f7a-a077-4e0f-80fa-0a510dba6e2f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.147704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8761f7a-a077-4e0f-80fa-0a510dba6e2f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.147981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8761f7a-a077-4e0f-80fa-0a510dba6e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.165605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e8761f7a-a077-4e0f-80fa-0a510dba6e2f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:21.166787 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e8761f7a-a077-4e0f-80fa-0a510dba6e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.174493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 968/1962] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:21.180859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8761f7a-a077-4e0f-80fa-0a510dba6e2f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.180859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e8761f7a-a077-4e0f-80fa-0a510dba6e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.188002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8761f7a-a077-4e0f-80fa-0a510dba6e2f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.193105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b926d-2dcf-495a-ac9f-a8f7bb40f5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.193762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b926d-2dcf-495a-ac9f-a8f7bb40f5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.194046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b926d-2dcf-495a-ac9f-a8f7bb40f5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.194321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b926d-2dcf-495a-ac9f-a8f7bb40f5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.195106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b926d-2dcf-495a-ac9f-a8f7bb40f5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.197014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b926d-2dcf-495a-ac9f-a8f7bb40f5b6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.275882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:21.285145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed18f00663a44f87ac804f32cb090347', 'request_id': 'req-17446f19-13b6-41c0-8c60-346cf80efd43'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:21.325413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 969/1963] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:21 2022] POST /identity/v3/users => generated 298 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:21.326358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b926d-2dcf-495a-ac9f-a8f7bb40f5b6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.335871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b926d-2dcf-495a-ac9f-a8f7bb40f5b6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.379688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:21.394483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03efbd-12b1-4a56-8c42-b9ccdb8bf455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.395587 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03efbd-12b1-4a56-8c42-b9ccdb8bf455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.395870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03efbd-12b1-4a56-8c42-b9ccdb8bf455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.396146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03efbd-12b1-4a56-8c42-b9ccdb8bf455 admin admin] PATH_INFO: `/v3/projects/5c909735438f471b8f9cf421da5a5193/users/6c391a99e9d74cd1867f29b1dbe811a4/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.398145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03efbd-12b1-4a56-8c42-b9ccdb8bf455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c909735438f471b8f9cf421da5a5193, user_id=6c391a99e9d74cd1867f29b1dbe811a4, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.400986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03efbd-12b1-4a56-8c42-b9ccdb8bf455 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.413320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 970/1964] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:21 2022] PUT /identity/v3/projects/5c909735438f471b8f9cf421da5a5193/users/6c391a99e9d74cd1867f29b1dbe811a4/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:21.414131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03efbd-12b1-4a56-8c42-b9ccdb8bf455 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.415938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2d03efbd-12b1-4a56-8c42-b9ccdb8bf455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.434564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed18f00663a44f87ac804f32cb090347', 'request_id': 'req-17446f19-13b6-41c0-8c60-346cf80efd43'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:21.441425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed18f00663a44f87ac804f32cb090347', 'request_id': 'req-17446f19-13b6-41c0-8c60-346cf80efd43'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:21.452982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] The token cache is being invalidate because project ed18f00663a44f87ac804f32cb090347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:21.453267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:21.453961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:21.455687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 995/1965] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:21 2022] DELETE /identity/v3/projects/ed18f00663a44f87ac804f32cb090347 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:21.457619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.457749 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.470410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17446f19-13b6-41c0-8c60-346cf80efd43 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.476660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03efbd-12b1-4a56-8c42-b9ccdb8bf455 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.480719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e438c2c-2f48-4e50-a440-4b601c721dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.481370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438c2c-2f48-4e50-a440-4b601c721dfe service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.481658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438c2c-2f48-4e50-a440-4b601c721dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.481938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e438c2c-2f48-4e50-a440-4b601c721dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.483933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9e438c2c-2f48-4e50-a440-4b601c721dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.528243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55720635-7ac8-4515-b2b4-830a7e04a9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.528935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720635-7ac8-4515-b2b4-830a7e04a9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.529214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720635-7ac8-4515-b2b4-830a7e04a9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.529497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55720635-7ac8-4515-b2b4-830a7e04a9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.530229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720635-7ac8-4515-b2b4-830a7e04a9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.531878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55720635-7ac8-4515-b2b4-830a7e04a9f6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.543391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 996/1966] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:21.543391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457023e-38a3-4bcf-9213-b4e64344b569 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.543640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457023e-38a3-4bcf-9213-b4e64344b569 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.550772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457023e-38a3-4bcf-9213-b4e64344b569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.550942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e438c2c-2f48-4e50-a440-4b601c721dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.551040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e438c2c-2f48-4e50-a440-4b601c721dfe service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.561926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 971/1967] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:21.563254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d630ed-a6c4-43b2-afa0-ccd41bb3303b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.563549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d630ed-a6c4-43b2-afa0-ccd41bb3303b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.563828 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d630ed-a6c4-43b2-afa0-ccd41bb3303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.582602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7457023e-38a3-4bcf-9213-b4e64344b569 None None] MFA Rules not processed for user `6c391a99e9d74cd1867f29b1dbe811a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:21.583358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d3d630ed-a6c4-43b2-afa0-ccd41bb3303b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:21.583953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7457023e-38a3-4bcf-9213-b4e64344b569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.585256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d3d630ed-a6c4-43b2-afa0-ccd41bb3303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.600853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 972/1968] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:21.601738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d630ed-a6c4-43b2-afa0-ccd41bb3303b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.613109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d630ed-a6c4-43b2-afa0-ccd41bb3303b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.623936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e926b-f8d7-4e78-bbdf-9ddc8094027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.625176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e926b-f8d7-4e78-bbdf-9ddc8094027c admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.625608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e926b-f8d7-4e78-bbdf-9ddc8094027c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.626044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e926b-f8d7-4e78-bbdf-9ddc8094027c admin admin] PATH_INFO: `/v3/projects/b048ba18e8d84b7d9ec63de1b3a115fd/users/1f9abff222e244bd83ec0c8abb064397/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.644253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e926b-f8d7-4e78-bbdf-9ddc8094027c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b048ba18e8d84b7d9ec63de1b3a115fd, user_id=1f9abff222e244bd83ec0c8abb064397, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.647013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e926b-f8d7-4e78-bbdf-9ddc8094027c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.676940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 997/1969] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:21.678346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e6c8-3037-4213-8360-9a67b5fff3da None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.678639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e6c8-3037-4213-8360-9a67b5fff3da None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.678952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02e6c8-3037-4213-8360-9a67b5fff3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.698143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2d02e6c8-3037-4213-8360-9a67b5fff3da None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:21.699410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2d02e6c8-3037-4213-8360-9a67b5fff3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.707491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 998/1970] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:21.708389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e6c8-3037-4213-8360-9a67b5fff3da None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.709579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2d02e6c8-3037-4213-8360-9a67b5fff3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:21.722134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 973/1971] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:21 2022] PUT /identity/v3/projects/b048ba18e8d84b7d9ec63de1b3a115fd/users/1f9abff222e244bd83ec0c8abb064397/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:21.723031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e926b-f8d7-4e78-bbdf-9ddc8094027c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.755648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:21.773512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02e6c8-3037-4213-8360-9a67b5fff3da None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.810826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e926b-f8d7-4e78-bbdf-9ddc8094027c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.816472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec67a-4018-4189-9a11-1dcfed9cfbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.817514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec67a-4018-4189-9a11-1dcfed9cfbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.817514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec67a-4018-4189-9a11-1dcfed9cfbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.817514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ec67a-4018-4189-9a11-1dcfed9cfbd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.818263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec67a-4018-4189-9a11-1dcfed9cfbd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:21.818580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec67a-4018-4189-9a11-1dcfed9cfbd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.820488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ec67a-4018-4189-9a11-1dcfed9cfbd9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.823691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:21.840451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 974/1972] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:21.840451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec67a-4018-4189-9a11-1dcfed9cfbd9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.843420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c3b9b-bbae-49ed-931e-efa6cce8b604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.844674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c3b9b-bbae-49ed-931e-efa6cce8b604 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.844674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c3b9b-bbae-49ed-931e-efa6cce8b604 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.845152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c3b9b-bbae-49ed-931e-efa6cce8b604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.851928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ec67a-4018-4189-9a11-1dcfed9cfbd9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.857727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fd855-bd92-4eed-bb16-6895088326cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.858464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fd855-bd92-4eed-bb16-6895088326cc admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.858690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fd855-bd92-4eed-bb16-6895088326cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.859406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fd855-bd92-4eed-bb16-6895088326cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.860152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fd855-bd92-4eed-bb16-6895088326cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.861856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fd855-bd92-4eed-bb16-6895088326cc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.875296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 975/1973] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:21.876273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fd855-bd92-4eed-bb16-6895088326cc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.887237 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fd855-bd92-4eed-bb16-6895088326cc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.892692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d39474-176b-4a42-8ff7-a4d80d7ade0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.902209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d39474-176b-4a42-8ff7-a4d80d7ade0b admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.902209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d39474-176b-4a42-8ff7-a4d80d7ade0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.902209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d39474-176b-4a42-8ff7-a4d80d7ade0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.902209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d39474-176b-4a42-8ff7-a4d80d7ade0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.902209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d39474-176b-4a42-8ff7-a4d80d7ade0b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.936686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c3b9b-bbae-49ed-931e-efa6cce8b604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.938139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c3b9b-bbae-49ed-931e-efa6cce8b604 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.948922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 999/1974] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:21.949726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c3b9b-bbae-49ed-931e-efa6cce8b604 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:21.965872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c3b9b-bbae-49ed-931e-efa6cce8b604 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:21.966675 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea7d68-19d3-4314-8bc6-09b0f8436b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:21.967639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7d68-19d3-4314-8bc6-09b0f8436b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.967921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7d68-19d3-4314-8bc6-09b0f8436b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.968205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea7d68-19d3-4314-8bc6-09b0f8436b27 admin admin] PATH_INFO: `/v3/projects/b048ba18e8d84b7d9ec63de1b3a115fd/users/1f9abff222e244bd83ec0c8abb064397/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:21.970189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea7d68-19d3-4314-8bc6-09b0f8436b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b048ba18e8d84b7d9ec63de1b3a115fd, user_id=1f9abff222e244bd83ec0c8abb064397, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:21.972868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea7d68-19d3-4314-8bc6-09b0f8436b27 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:21.984014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1000/1975] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:21 2022] PUT /identity/v3/projects/b048ba18e8d84b7d9ec63de1b3a115fd/users/1f9abff222e244bd83ec0c8abb064397/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:21.996121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d131-50c3-43a6-9e2c-019f602e6fd6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:21.996415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d131-50c3-43a6-9e2c-019f602e6fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:21.996696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7d131-50c3-43a6-9e2c-019f602e6fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.021269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 976/1976] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:21 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:22.025446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-15e7d131-50c3-43a6-9e2c-019f602e6fd6 None None] MFA Rules not processed for user `1f9abff222e244bd83ec0c8abb064397`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:22.027378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-15e7d131-50c3-43a6-9e2c-019f602e6fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:22.027528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d39474-176b-4a42-8ff7-a4d80d7ade0b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:22.120338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1001/1977] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:22.121952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d131-50c3-43a6-9e2c-019f602e6fd6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:22.122558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d39474-176b-4a42-8ff7-a4d80d7ade0b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:22.123728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-15e7d131-50c3-43a6-9e2c-019f602e6fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:22.127724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0068-a2c5-442f-9cd6-ae56b3c75f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:22.128412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0068-a2c5-442f-9cd6-ae56b3c75f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.128744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0068-a2c5-442f-9cd6-ae56b3c75f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.129030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a0068-a2c5-442f-9cd6-ae56b3c75f9d admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.129769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a0068-a2c5-442f-9cd6-ae56b3c75f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:22.131900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a0068-a2c5-442f-9cd6-ae56b3c75f9d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:22.139511 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7d131-50c3-43a6-9e2c-019f602e6fd6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:22.144311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:22.145246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.145594 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.145976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] PATH_INFO: `/v3/projects/88c7d24340184bc7ad9ba9c3413c470f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.147298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c7d24340184bc7ad9ba9c3413c470f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:22.149291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:22.206114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 977/1978] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:22 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:47:22.207131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0068-a2c5-442f-9cd6-ae56b3c75f9d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:22.260714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c7d24340184bc7ad9ba9c3413c470f', 'request_id': 'req-af4ef916-1eb8-4198-af10-d27678668f73'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.264861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a0068-a2c5-442f-9cd6-ae56b3c75f9d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:22.313943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d9eac-a8e1-4508-a321-31baf749d46c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:22.314588 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d9eac-a8e1-4508-a321-31baf749d46c service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.314898 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d9eac-a8e1-4508-a321-31baf749d46c service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.315181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d9eac-a8e1-4508-a321-31baf749d46c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.316987 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8a3d9eac-a8e1-4508-a321-31baf749d46c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:22.337929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:22.339942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c7d24340184bc7ad9ba9c3413c470f', 'request_id': 'req-af4ef916-1eb8-4198-af10-d27678668f73'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.346979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c7d24340184bc7ad9ba9c3413c470f', 'request_id': 'req-af4ef916-1eb8-4198-af10-d27678668f73'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.360804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] The token cache is being invalidate because project 88c7d24340184bc7ad9ba9c3413c470f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:22.361178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.361891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.363591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1002/1979] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:22 2022] DELETE /identity/v3/projects/88c7d24340184bc7ad9ba9c3413c470f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:22.367069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:22.368372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:22.378146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d9eac-a8e1-4508-a321-31baf749d46c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:22.379632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d9eac-a8e1-4508-a321-31baf749d46c service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:22.380972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ef916-1eb8-4198-af10-d27678668f73 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:22.384756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:22.385650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.385933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.386209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.388221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:22.388905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 978/1980] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:22.389714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d9eac-a8e1-4508-a321-31baf749d46c service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:22.419462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:22.463228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:22.463228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:22.463636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d9eac-a8e1-4508-a321-31baf749d46c service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:22.463636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461f109-afcf-44f4-875c-8e328af356a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:22.464254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461f109-afcf-44f4-875c-8e328af356a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.464544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461f109-afcf-44f4-875c-8e328af356a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.464931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461f109-afcf-44f4-875c-8e328af356a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.465625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461f109-afcf-44f4-875c-8e328af356a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:22.467011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1003/1981] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:22.467433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461f109-afcf-44f4-875c-8e328af356a4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:22.469252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:22.470885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:22.479920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 979/1982] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:22.484231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461f109-afcf-44f4-875c-8e328af356a4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:22.487184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c461f109-afcf-44f4-875c-8e328af356a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:22.491553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d26798-5197-4647-bbd9-39d16ec0596f service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:22.499501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:22.501331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461f109-afcf-44f4-875c-8e328af356a4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:22.501607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.502100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.502462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] PATH_INFO: `/v3/users/d84ca56183e948eaae4170267217ca0f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.504743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84ca56183e948eaae4170267217ca0f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:22.508005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c43ff2-208e-48bd-b9a0-e0630f2875a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:22.509445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:22.509566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c43ff2-208e-48bd-b9a0-e0630f2875a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.509566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c43ff2-208e-48bd-b9a0-e0630f2875a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.510145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c43ff2-208e-48bd-b9a0-e0630f2875a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.511043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c43ff2-208e-48bd-b9a0-e0630f2875a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:22.512684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c43ff2-208e-48bd-b9a0-e0630f2875a4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:22.525431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 980/1983] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:22.529409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c43ff2-208e-48bd-b9a0-e0630f2875a4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:22.540279 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c43ff2-208e-48bd-b9a0-e0630f2875a4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:22.545611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b7167-979b-4662-b691-0d182b5406b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:22.546495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b7167-979b-4662-b691-0d182b5406b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.546803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b7167-979b-4662-b691-0d182b5406b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.547113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b7167-979b-4662-b691-0d182b5406b1 admin admin] PATH_INFO: `/v3/projects/d389db21323c40d7adb245a3bf6b791d/users/50739bd762fb48cea804b10e5b9d6e6e/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.562678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b7167-979b-4662-b691-0d182b5406b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d389db21323c40d7adb245a3bf6b791d, user_id=50739bd762fb48cea804b10e5b9d6e6e, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:22.565422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b7167-979b-4662-b691-0d182b5406b1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:22.727917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 981/1984] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:22 2022] PUT /identity/v3/projects/d389db21323c40d7adb245a3bf6b791d/users/50739bd762fb48cea804b10e5b9d6e6e/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:22.738916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4274-a183-439c-a9d1-a95ca74639d8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.739210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4274-a183-439c-a9d1-a95ca74639d8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.739493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4274-a183-439c-a9d1-a95ca74639d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.765935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e5be4274-a183-439c-a9d1-a95ca74639d8 None None] MFA Rules not processed for user `50739bd762fb48cea804b10e5b9d6e6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:22.767182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e5be4274-a183-439c-a9d1-a95ca74639d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:22.833874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 982/1985] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:22.839397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be4274-a183-439c-a9d1-a95ca74639d8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:22.857369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84ca56183e948eaae4170267217ca0f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.873198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84ca56183e948eaae4170267217ca0f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.907891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be4274-a183-439c-a9d1-a95ca74639d8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:22.912582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc0da6-2de0-4b7b-af0e-90432a643a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:22.913243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc0da6-2de0-4b7b-af0e-90432a643a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:22.913527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc0da6-2de0-4b7b-af0e-90432a643a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:22.913838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc0da6-2de0-4b7b-af0e-90432a643a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:22.914532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc0da6-2de0-4b7b-af0e-90432a643a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:22.917190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc0da6-2de0-4b7b-af0e-90432a643a47 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:22.939498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84ca56183e948eaae4170267217ca0f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.940130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84ca56183e948eaae4170267217ca0f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.949635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84ca56183e948eaae4170267217ca0f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:22.957488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1004/1986] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:22 2022] DELETE /identity/v3/users/d84ca56183e948eaae4170267217ca0f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:23.032842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 983/1987] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:22 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:23.036893 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.038425 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:23.111354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577a425-0e44-4695-a974-4654c25dffdd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.178058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16349c-3f76-4668-a07e-61c5698d1063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.184411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16349c-3f76-4668-a07e-61c5698d1063 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.184411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16349c-3f76-4668-a07e-61c5698d1063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.184411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16349c-3f76-4668-a07e-61c5698d1063 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.184411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16349c-3f76-4668-a07e-61c5698d1063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.184411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16349c-3f76-4668-a07e-61c5698d1063 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.205467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:23.294465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:23.300394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1005/1988] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:23 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:23.304471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc0da6-2de0-4b7b-af0e-90432a643a47 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.316336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc0da6-2de0-4b7b-af0e-90432a643a47 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.320999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5d228-f8d5-440b-b7b1-7d0baa561241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.321891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5d228-f8d5-440b-b7b1-7d0baa561241 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.322243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5d228-f8d5-440b-b7b1-7d0baa561241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.322789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5d228-f8d5-440b-b7b1-7d0baa561241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.323537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5d228-f8d5-440b-b7b1-7d0baa561241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.327808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5d228-f8d5-440b-b7b1-7d0baa561241 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.337973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 984/1989] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:23.342337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16349c-3f76-4668-a07e-61c5698d1063 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.352593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16349c-3f76-4668-a07e-61c5698d1063 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.358531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48289846-05e2-4343-b2e1-636c9df29172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.359339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48289846-05e2-4343-b2e1-636c9df29172 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.359697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48289846-05e2-4343-b2e1-636c9df29172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.360046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48289846-05e2-4343-b2e1-636c9df29172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.360792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48289846-05e2-4343-b2e1-636c9df29172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.362471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48289846-05e2-4343-b2e1-636c9df29172 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.377650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1006/1990] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:23.378957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5d228-f8d5-440b-b7b1-7d0baa561241 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.390164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5d228-f8d5-440b-b7b1-7d0baa561241 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.395307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01990577-8af7-43b6-8d8e-c57b852954cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.396286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990577-8af7-43b6-8d8e-c57b852954cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.396571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990577-8af7-43b6-8d8e-c57b852954cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.396848 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01990577-8af7-43b6-8d8e-c57b852954cc admin admin] PATH_INFO: `/v3/projects/799b488b457d49e08cc19ae5a5212f4a/users/0a8c705656b548e781faccb0343b8574/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.412278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01990577-8af7-43b6-8d8e-c57b852954cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=799b488b457d49e08cc19ae5a5212f4a, user_id=0a8c705656b548e781faccb0343b8574, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.414979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01990577-8af7-43b6-8d8e-c57b852954cc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.459362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48289846-05e2-4343-b2e1-636c9df29172 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.461502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-48289846-05e2-4343-b2e1-636c9df29172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:23.479417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48289846-05e2-4343-b2e1-636c9df29172 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.491889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 985/1991] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:23 2022] PUT /identity/v3/projects/799b488b457d49e08cc19ae5a5212f4a/users/0a8c705656b548e781faccb0343b8574/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:23.495472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aac562-4154-4d9b-b2d3-d760a2923d7c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.495613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aac562-4154-4d9b-b2d3-d760a2923d7c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.495884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aac562-4154-4d9b-b2d3-d760a2923d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.524744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-44aac562-4154-4d9b-b2d3-d760a2923d7c None None] MFA Rules not processed for user `0a8c705656b548e781faccb0343b8574`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:23.526157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-44aac562-4154-4d9b-b2d3-d760a2923d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:23.548736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.550559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.550559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.550559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] PATH_INFO: `/v3/projects/8daf2431c8c147238828652ed39bbd3b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.551570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8daf2431c8c147238828652ed39bbd3b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.553481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.597905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 986/1992] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:23.602602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aac562-4154-4d9b-b2d3-d760a2923d7c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.612979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aac562-4154-4d9b-b2d3-d760a2923d7c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.617554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cc5aa-11ce-4813-8d41-fb1c6142e601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.618196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cc5aa-11ce-4813-8d41-fb1c6142e601 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.618480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cc5aa-11ce-4813-8d41-fb1c6142e601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.618755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0cc5aa-11ce-4813-8d41-fb1c6142e601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.620061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cc5aa-11ce-4813-8d41-fb1c6142e601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.622126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0cc5aa-11ce-4813-8d41-fb1c6142e601 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.668245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8daf2431c8c147238828652ed39bbd3b', 'request_id': 'req-fdc66401-54e6-4588-a442-7f29983216f1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:23.717881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 987/1993] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:23 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:47:23.721819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cc5aa-11ce-4813-8d41-fb1c6142e601 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.733728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8daf2431c8c147238828652ed39bbd3b', 'request_id': 'req-fdc66401-54e6-4588-a442-7f29983216f1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:23.740013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8daf2431c8c147238828652ed39bbd3b', 'request_id': 'req-fdc66401-54e6-4588-a442-7f29983216f1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:23.752294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] The token cache is being invalidate because project 8daf2431c8c147238828652ed39bbd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:23.752584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:23.753254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fdc66401-54e6-4588-a442-7f29983216f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:23.754837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1007/1994] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:23 2022] DELETE /identity/v3/projects/8daf2431c8c147238828652ed39bbd3b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:23.759558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527f45-5e56-4fef-875c-680d55385b4b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.760394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527f45-5e56-4fef-875c-680d55385b4b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.760813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91527f45-5e56-4fef-875c-680d55385b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.778668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-91527f45-5e56-4fef-875c-680d55385b4b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:23.779852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-91527f45-5e56-4fef-875c-680d55385b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:23.788135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1008/1995] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:23.790471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0cc5aa-11ce-4813-8d41-fb1c6142e601 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.795438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eab5c-14a9-4ebf-b8a7-62a7bc90a2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.795575 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c4853-0af5-4de9-a97f-1b1e7f8b24aa None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.795827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c4853-0af5-4de9-a97f-1b1e7f8b24aa None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.796108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c4853-0af5-4de9-a97f-1b1e7f8b24aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.796200 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eab5c-14a9-4ebf-b8a7-62a7bc90a2ac admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.796448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eab5c-14a9-4ebf-b8a7-62a7bc90a2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.796725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eab5c-14a9-4ebf-b8a7-62a7bc90a2ac admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.797414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eab5c-14a9-4ebf-b8a7-62a7bc90a2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.799382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eab5c-14a9-4ebf-b8a7-62a7bc90a2ac admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.814289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-579c4853-0af5-4de9-a97f-1b1e7f8b24aa None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:23.815467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-579c4853-0af5-4de9-a97f-1b1e7f8b24aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:23.824223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1009/1996] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:23.828265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c4853-0af5-4de9-a97f-1b1e7f8b24aa None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.837010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c4853-0af5-4de9-a97f-1b1e7f8b24aa None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.841784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227008cd-2d63-4104-adb1-ff9fcbde4f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.842426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227008cd-2d63-4104-adb1-ff9fcbde4f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.842713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227008cd-2d63-4104-adb1-ff9fcbde4f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.843036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227008cd-2d63-4104-adb1-ff9fcbde4f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.843756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227008cd-2d63-4104-adb1-ff9fcbde4f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:23.844071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227008cd-2d63-4104-adb1-ff9fcbde4f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.845655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227008cd-2d63-4104-adb1-ff9fcbde4f75 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.857661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1010/1997] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:47:23.867849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227008cd-2d63-4104-adb1-ff9fcbde4f75 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.877923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227008cd-2d63-4104-adb1-ff9fcbde4f75 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.882413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaad964-bbc4-4add-9da7-728aec4823b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.883141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaad964-bbc4-4add-9da7-728aec4823b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.883575 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaad964-bbc4-4add-9da7-728aec4823b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.883855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaad964-bbc4-4add-9da7-728aec4823b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.884536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaad964-bbc4-4add-9da7-728aec4823b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.886398 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaad964-bbc4-4add-9da7-728aec4823b9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.925210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 988/1998] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:23 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:47:23.929044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eab5c-14a9-4ebf-b8a7-62a7bc90a2ac admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.930597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-358eab5c-14a9-4ebf-b8a7-62a7bc90a2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:23.943635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eab5c-14a9-4ebf-b8a7-62a7bc90a2ac admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.948349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e72ba-2c71-4da9-8c5f-35fbc1f79b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.949001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e72ba-2c71-4da9-8c5f-35fbc1f79b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.949282 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e72ba-2c71-4da9-8c5f-35fbc1f79b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.950975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e72ba-2c71-4da9-8c5f-35fbc1f79b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.950975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e72ba-2c71-4da9-8c5f-35fbc1f79b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:23.951945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e72ba-2c71-4da9-8c5f-35fbc1f79b2f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:23.961689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 989/1999] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:23.965915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e72ba-2c71-4da9-8c5f-35fbc1f79b2f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:23.975133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e72ba-2c71-4da9-8c5f-35fbc1f79b2f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:23.980548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53abe34-1cdb-4383-b286-b7c5f7e0460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:23.981479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53abe34-1cdb-4383-b286-b7c5f7e0460f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:23.981765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53abe34-1cdb-4383-b286-b7c5f7e0460f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:23.982046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53abe34-1cdb-4383-b286-b7c5f7e0460f admin admin] PATH_INFO: `/v3/projects/d72b7e748cfd49c1b4e7411e8e590b7f/users/307c904fbf624c4faa7165cac04e1616/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:23.999432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53abe34-1cdb-4383-b286-b7c5f7e0460f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72b7e748cfd49c1b4e7411e8e590b7f, user_id=307c904fbf624c4faa7165cac04e1616, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.010112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53abe34-1cdb-4383-b286-b7c5f7e0460f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.010500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1011/2000] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:23 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:47:24.012457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaad964-bbc4-4add-9da7-728aec4823b9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:24.080699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaad964-bbc4-4add-9da7-728aec4823b9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:24.082899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:24.085610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21338-f433-4771-bdd1-1c31d841c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:24.086283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21338-f433-4771-bdd1-1c31d841c5fe admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.086573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21338-f433-4771-bdd1-1c31d841c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.086871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21338-f433-4771-bdd1-1c31d841c5fe admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.087662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce21338-f433-4771-bdd1-1c31d841c5fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.091721 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce21338-f433-4771-bdd1-1c31d841c5fe admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.126360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 990/2001] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:23 2022] PUT /identity/v3/projects/d72b7e748cfd49c1b4e7411e8e590b7f/users/307c904fbf624c4faa7165cac04e1616/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:24.130431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53abe34-1cdb-4383-b286-b7c5f7e0460f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:24.187510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1012/2002] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:24 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:24.191515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21338-f433-4771-bdd1-1c31d841c5fe admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:24.193680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53abe34-1cdb-4383-b286-b7c5f7e0460f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:24.198955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d398a3-41db-405a-89ed-d0cb0d4f1c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:24.199624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d398a3-41db-405a-89ed-d0cb0d4f1c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.199909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d398a3-41db-405a-89ed-d0cb0d4f1c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.200538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d398a3-41db-405a-89ed-d0cb0d4f1c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.201109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d398a3-41db-405a-89ed-d0cb0d4f1c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.201860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21338-f433-4771-bdd1-1c31d841c5fe admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:24.203545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d398a3-41db-405a-89ed-d0cb0d4f1c6c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.206966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6484d-d222-4976-aa79-99de998c0981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:24.207632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6484d-d222-4976-aa79-99de998c0981 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.207926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6484d-d222-4976-aa79-99de998c0981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.208280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6484d-d222-4976-aa79-99de998c0981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.210947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6484d-d222-4976-aa79-99de998c0981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.210947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6484d-d222-4976-aa79-99de998c0981 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.216958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 991/2003] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:24.221124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d398a3-41db-405a-89ed-d0cb0d4f1c6c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:24.226691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1013/2004] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:24.227948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6484d-d222-4976-aa79-99de998c0981 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:24.233955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d398a3-41db-405a-89ed-d0cb0d4f1c6c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:24.238740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4122a96-9ac9-4d9f-a5c2-f92d6261688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:24.242313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6484d-d222-4976-aa79-99de998c0981 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:24.242508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4122a96-9ac9-4d9f-a5c2-f92d6261688f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.242508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4122a96-9ac9-4d9f-a5c2-f92d6261688f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.242508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4122a96-9ac9-4d9f-a5c2-f92d6261688f admin admin] PATH_INFO: `/v3/projects/d72b7e748cfd49c1b4e7411e8e590b7f/users/307c904fbf624c4faa7165cac04e1616/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.243554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4122a96-9ac9-4d9f-a5c2-f92d6261688f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72b7e748cfd49c1b4e7411e8e590b7f, user_id=307c904fbf624c4faa7165cac04e1616, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.246368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4122a96-9ac9-4d9f-a5c2-f92d6261688f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.253776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a93f5d-93fd-4142-8cc6-e819d4458fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:24.254924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a93f5d-93fd-4142-8cc6-e819d4458fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.255279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a93f5d-93fd-4142-8cc6-e819d4458fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.256038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a93f5d-93fd-4142-8cc6-e819d4458fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.256787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a93f5d-93fd-4142-8cc6-e819d4458fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.258817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a93f5d-93fd-4142-8cc6-e819d4458fc8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.259913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 992/2005] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:24 2022] PUT /identity/v3/projects/d72b7e748cfd49c1b4e7411e8e590b7f/users/307c904fbf624c4faa7165cac04e1616/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:24.275165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1014/2006] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:24.275918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3a04c-d44d-44e6-a8a4-7e9c07196815 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.275918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3a04c-d44d-44e6-a8a4-7e9c07196815 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.275918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3a04c-d44d-44e6-a8a4-7e9c07196815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.279712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a93f5d-93fd-4142-8cc6-e819d4458fc8 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:24.292067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:24.297380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a93f5d-93fd-4142-8cc6-e819d4458fc8 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:24.303314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2ed3a04c-d44d-44e6-a8a4-7e9c07196815 None None] MFA Rules not processed for user `307c904fbf624c4faa7165cac04e1616`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:24.304579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2ed3a04c-d44d-44e6-a8a4-7e9c07196815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:24.362629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a552d-2b9b-4222-97ef-85096a1ceb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:24.363654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a552d-2b9b-4222-97ef-85096a1ceb47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.363938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a552d-2b9b-4222-97ef-85096a1ceb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.364470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a552d-2b9b-4222-97ef-85096a1ceb47 admin admin] PATH_INFO: `/v3/projects/dd265183ec2a45458ecdb34e05627659/users/de5c4e1253b34874ae3d8dbd3943e314/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.390009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 993/2007] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:24.396963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a552d-2b9b-4222-97ef-85096a1ceb47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd265183ec2a45458ecdb34e05627659, user_id=de5c4e1253b34874ae3d8dbd3943e314, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.399251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a552d-2b9b-4222-97ef-85096a1ceb47 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.404729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:24.462163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3a04c-d44d-44e6-a8a4-7e9c07196815 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:24.464231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2ed3a04c-d44d-44e6-a8a4-7e9c07196815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:24.524215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3a04c-d44d-44e6-a8a4-7e9c07196815 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:24.525106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1015/2008] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:24 2022] PUT /identity/v3/projects/dd265183ec2a45458ecdb34e05627659/users/de5c4e1253b34874ae3d8dbd3943e314/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:24.527333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073a960-b047-4e13-88e0-4f261644798a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.527694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073a960-b047-4e13-88e0-4f261644798a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.528113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073a960-b047-4e13-88e0-4f261644798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.556448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a073a960-b047-4e13-88e0-4f261644798a None None] MFA Rules not processed for user `de5c4e1253b34874ae3d8dbd3943e314`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:24.557890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a073a960-b047-4e13-88e0-4f261644798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:24.581582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c9b72-34e9-4883-8e20-71fb0288c971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:24.582275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c9b72-34e9-4883-8e20-71fb0288c971 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.582559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c9b72-34e9-4883-8e20-71fb0288c971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.582835 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c9b72-34e9-4883-8e20-71fb0288c971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.584777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-093c9b72-34e9-4883-8e20-71fb0288c971 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:24.626266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1016/2009] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:24.630878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073a960-b047-4e13-88e0-4f261644798a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:24.649958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c9b72-34e9-4883-8e20-71fb0288c971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.652672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c9b72-34e9-4883-8e20-71fb0288c971 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.661693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 994/2010] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:24.694132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073a960-b047-4e13-88e0-4f261644798a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:24.713313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc2852-a715-4298-bb32-559f8c5f463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:24.713313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2852-a715-4298-bb32-559f8c5f463b admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.713313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2852-a715-4298-bb32-559f8c5f463b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.713313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc2852-a715-4298-bb32-559f8c5f463b admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.713632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc2852-a715-4298-bb32-559f8c5f463b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.713632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc2852-a715-4298-bb32-559f8c5f463b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.782594 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:24.826638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1017/2011] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:24 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:47:24.831085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c9b72-34e9-4883-8e20-71fb0288c971 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:24.842598 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c9b72-34e9-4883-8e20-71fb0288c971 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:24.929075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf96461-1e21-4493-bc82-f688c4b3829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:24.929883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf96461-1e21-4493-bc82-f688c4b3829e admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:24.930187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf96461-1e21-4493-bc82-f688c4b3829e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:24.930460 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf96461-1e21-4493-bc82-f688c4b3829e admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:24.931205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf96461-1e21-4493-bc82-f688c4b3829e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:24.934169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf96461-1e21-4493-bc82-f688c4b3829e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:24.944603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:25.044694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 995/2012] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:24 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:47:25.046044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc2852-a715-4298-bb32-559f8c5f463b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:25.053119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf96461-1e21-4493-bc82-f688c4b3829e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:25.054890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-eaf96461-1e21-4493-bc82-f688c4b3829e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:25.068593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc2852-a715-4298-bb32-559f8c5f463b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:25.073525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb331d-48f4-4b93-a71d-9c4e62114c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:25.074163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb331d-48f4-4b93-a71d-9c4e62114c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:25.074454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb331d-48f4-4b93-a71d-9c4e62114c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:25.074735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb331d-48f4-4b93-a71d-9c4e62114c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:25.075505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb331d-48f4-4b93-a71d-9c4e62114c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:25.077163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb331d-48f4-4b93-a71d-9c4e62114c25 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:25.088129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1018/2013] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:25.092287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb331d-48f4-4b93-a71d-9c4e62114c25 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:25.102087 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb331d-48f4-4b93-a71d-9c4e62114c25 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:25.106820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f820c8-aa22-441f-853f-954a72abc91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:25.107868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f820c8-aa22-441f-853f-954a72abc91d admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:25.108296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f820c8-aa22-441f-853f-954a72abc91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:25.108578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f820c8-aa22-441f-853f-954a72abc91d admin admin] PATH_INFO: `/v3/projects/39ad67ed6955426896f8bf5ec037f62d/users/367ada6adbbb4c208f6098d5b04e0a9c/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:25.116500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf96461-1e21-4493-bc82-f688c4b3829e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:25.120946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc6d68-301b-4954-bf3f-ecc82b71ed60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:25.121681 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc6d68-301b-4954-bf3f-ecc82b71ed60 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:25.122235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc6d68-301b-4954-bf3f-ecc82b71ed60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:25.127182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc6d68-301b-4954-bf3f-ecc82b71ed60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:25.127182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-56cc6d68-301b-4954-bf3f-ecc82b71ed60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:25.127608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f820c8-aa22-441f-853f-954a72abc91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ad67ed6955426896f8bf5ec037f62d, user_id=367ada6adbbb4c208f6098d5b04e0a9c, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:25.129018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f820c8-aa22-441f-853f-954a72abc91d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:25.185871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc6d68-301b-4954-bf3f-ecc82b71ed60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:25.187388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc6d68-301b-4954-bf3f-ecc82b71ed60 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:25.196551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 996/2014] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:25.220441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1019/2015] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:25 2022] PUT /identity/v3/projects/39ad67ed6955426896f8bf5ec037f62d/users/367ada6adbbb4c208f6098d5b04e0a9c/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:25.224665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc6d68-301b-4954-bf3f-ecc82b71ed60 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:25.235830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc6d68-301b-4954-bf3f-ecc82b71ed60 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:25.304552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9c9ea-8934-4c07-ab4f-2f5491a582ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:25.305358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9c9ea-8934-4c07-ab4f-2f5491a582ff admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:25.305706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9c9ea-8934-4c07-ab4f-2f5491a582ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:25.306083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9c9ea-8934-4c07-ab4f-2f5491a582ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:25.307604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9c9ea-8934-4c07-ab4f-2f5491a582ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:25.310330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9c9ea-8934-4c07-ab4f-2f5491a582ff admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:25.331678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 997/2016] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:25.332863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f820c8-aa22-441f-853f-954a72abc91d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:25.344722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f820c8-aa22-441f-853f-954a72abc91d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:25.349528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d731d3e-7bfd-4a8d-b3a2-47a80e389863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:25.352694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d731d3e-7bfd-4a8d-b3a2-47a80e389863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:25.352694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d731d3e-7bfd-4a8d-b3a2-47a80e389863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:25.352694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d731d3e-7bfd-4a8d-b3a2-47a80e389863 admin admin] PATH_INFO: `/v3/projects/39ad67ed6955426896f8bf5ec037f62d/users/367ada6adbbb4c208f6098d5b04e0a9c/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:25.353128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d731d3e-7bfd-4a8d-b3a2-47a80e389863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ad67ed6955426896f8bf5ec037f62d, user_id=367ada6adbbb4c208f6098d5b04e0a9c, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:25.356375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d731d3e-7bfd-4a8d-b3a2-47a80e389863 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:25.367227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1020/2017] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:25 2022] PUT /identity/v3/projects/39ad67ed6955426896f8bf5ec037f62d/users/367ada6adbbb4c208f6098d5b04e0a9c/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:25.391291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27a492-1b94-425c-913e-a65d5ac09461 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:25.391835 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27a492-1b94-425c-913e-a65d5ac09461 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:25.391835 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27a492-1b94-425c-913e-a65d5ac09461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:25.421178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bc27a492-1b94-425c-913e-a65d5ac09461 None None] MFA Rules not processed for user `367ada6adbbb4c208f6098d5b04e0a9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:25.422390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bc27a492-1b94-425c-913e-a65d5ac09461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:25.497250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 998/2018] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:25 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:25.508826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d731d3e-7bfd-4a8d-b3a2-47a80e389863 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:25.567697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d731d3e-7bfd-4a8d-b3a2-47a80e389863 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:25.571374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fca4a3-68e8-4a25-b8a8-821756f4de17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:25.572028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fca4a3-68e8-4a25-b8a8-821756f4de17 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:25.572658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fca4a3-68e8-4a25-b8a8-821756f4de17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:25.572658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fca4a3-68e8-4a25-b8a8-821756f4de17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:25.587383 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fca4a3-68e8-4a25-b8a8-821756f4de17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:25.588977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fca4a3-68e8-4a25-b8a8-821756f4de17 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:25.600259 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1021/2019] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:25 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:25.762464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:25.837173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:26.417423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27a492-1b94-425c-913e-a65d5ac09461 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:26.427712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27a492-1b94-425c-913e-a65d5ac09461 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:26.431471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfebff-74d3-43a5-84f9-694518141451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:26.432731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfebff-74d3-43a5-84f9-694518141451 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:26.433018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfebff-74d3-43a5-84f9-694518141451 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:26.433288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfebff-74d3-43a5-84f9-694518141451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:26.491120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfebff-74d3-43a5-84f9-694518141451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:26.492562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfebff-74d3-43a5-84f9-694518141451 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:26.502565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 999/2020] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:27.222232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fca4a3-68e8-4a25-b8a8-821756f4de17 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:27.231104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fca4a3-68e8-4a25-b8a8-821756f4de17 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:27.234709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0622b7-43ad-49c7-b1de-dc6cee52bef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:27.235375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0622b7-43ad-49c7-b1de-dc6cee52bef8 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:27.235659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0622b7-43ad-49c7-b1de-dc6cee52bef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:27.235935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0622b7-43ad-49c7-b1de-dc6cee52bef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:27.237702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9f0622b7-43ad-49c7-b1de-dc6cee52bef8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:27.302667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0622b7-43ad-49c7-b1de-dc6cee52bef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:27.304182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0622b7-43ad-49c7-b1de-dc6cee52bef8 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:27.314439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1022/2021] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:27.423871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfebff-74d3-43a5-84f9-694518141451 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:27.432123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfebff-74d3-43a5-84f9-694518141451 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:27.436555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f3d28-657e-4aae-a3a5-282332ddc8ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:27.437191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f3d28-657e-4aae-a3a5-282332ddc8ce service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:27.437475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f3d28-657e-4aae-a3a5-282332ddc8ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:27.437753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f3d28-657e-4aae-a3a5-282332ddc8ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:27.439529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c83f3d28-657e-4aae-a3a5-282332ddc8ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:27.499019 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f3d28-657e-4aae-a3a5-282332ddc8ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:27.500386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f3d28-657e-4aae-a3a5-282332ddc8ce service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:27.509392 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1000/2022] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:29.379109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0622b7-43ad-49c7-b1de-dc6cee52bef8 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:29.387876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0622b7-43ad-49c7-b1de-dc6cee52bef8 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:29.393062 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc154de-76c4-4a1c-b9b1-c0cc7a5cacdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:29.393883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc154de-76c4-4a1c-b9b1-c0cc7a5cacdc service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:29.394319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc154de-76c4-4a1c-b9b1-c0cc7a5cacdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:29.394743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc154de-76c4-4a1c-b9b1-c0cc7a5cacdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:29.469781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc154de-76c4-4a1c-b9b1-c0cc7a5cacdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:29.471510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc154de-76c4-4a1c-b9b1-c0cc7a5cacdc service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:29.482879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1023/2023] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:30.926178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f3d28-657e-4aae-a3a5-282332ddc8ce service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:30.989081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f3d28-657e-4aae-a3a5-282332ddc8ce service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:30.993619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:30.994490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:30.994769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:30.995133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] PATH_INFO: `/v3/users/de5c4e1253b34874ae3d8dbd3943e314` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:30.996660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5c4e1253b34874ae3d8dbd3943e314)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:30.998671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:31.004273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:31.202082 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5c4e1253b34874ae3d8dbd3943e314'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:31.202741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5c4e1253b34874ae3d8dbd3943e314'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:31.215257 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5c4e1253b34874ae3d8dbd3943e314'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:31.222744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5c4e1253b34874ae3d8dbd3943e314'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:31.321674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5c4e1253b34874ae3d8dbd3943e314'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:31.329170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1001/2024] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:30 2022] DELETE /identity/v3/users/de5c4e1253b34874ae3d8dbd3943e314 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:31.333904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c243d-5486-4f59-a2dd-b2b6032f60d3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:31.334435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c243d-5486-4f59-a2dd-b2b6032f60d3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:31.334525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c243d-5486-4f59-a2dd-b2b6032f60d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:31.352128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d51c243d-5486-4f59-a2dd-b2b6032f60d3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:31.353307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d51c243d-5486-4f59-a2dd-b2b6032f60d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:31.372342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:31.415672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1024/2025] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:31.425792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:31.427484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:31.513133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a527cf-4c0c-4439-8c2b-71c7823366d3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:31.518071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295b50b-f012-4234-b73a-5477ea03de68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:31.518808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295b50b-f012-4234-b73a-5477ea03de68 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:31.519130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295b50b-f012-4234-b73a-5477ea03de68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:31.519480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295b50b-f012-4234-b73a-5477ea03de68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:31.529694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295b50b-f012-4234-b73a-5477ea03de68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:31.532206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295b50b-f012-4234-b73a-5477ea03de68 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:31.542803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1002/2026] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:31.978409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c243d-5486-4f59-a2dd-b2b6032f60d3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:31.979885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d51c243d-5486-4f59-a2dd-b2b6032f60d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:31.999029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c243d-5486-4f59-a2dd-b2b6032f60d3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:32.006208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:32.006208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:32.006208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:32.006208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] PATH_INFO: `/v3/projects/dd265183ec2a45458ecdb34e05627659` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:32.007020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd265183ec2a45458ecdb34e05627659)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:32.008593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:32.129235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd265183ec2a45458ecdb34e05627659', 'request_id': 'req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.190868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd265183ec2a45458ecdb34e05627659', 'request_id': 'req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.197253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd265183ec2a45458ecdb34e05627659', 'request_id': 'req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.210552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] The token cache is being invalidate because project dd265183ec2a45458ecdb34e05627659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:32.210872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.212151 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.213704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1025/2027] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:31 2022] DELETE /identity/v3/projects/dd265183ec2a45458ecdb34e05627659 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:32.217693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295b50b-f012-4234-b73a-5477ea03de68 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:32.228576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295b50b-f012-4234-b73a-5477ea03de68 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:32.291660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:32.292859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:32.293145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:32.293424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] PATH_INFO: `/v3/users/367ada6adbbb4c208f6098d5b04e0a9c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:32.294976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=367ada6adbbb4c208f6098d5b04e0a9c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:32.296905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:32.506282 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:32.532351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367ada6adbbb4c208f6098d5b04e0a9c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.533109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367ada6adbbb4c208f6098d5b04e0a9c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.548103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367ada6adbbb4c208f6098d5b04e0a9c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.557817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367ada6adbbb4c208f6098d5b04e0a9c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.651273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367ada6adbbb4c208f6098d5b04e0a9c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:32.660830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1003/2028] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:32 2022] DELETE /identity/v3/users/367ada6adbbb4c208f6098d5b04e0a9c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:33.164984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:33.167732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:33.184969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833fd70-cd09-4c91-a3a6-d3d0ddaab353 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:33.213201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:33.214626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:33.254918 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:33.256160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.256741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.257211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] PATH_INFO: `/v3/projects/39ad67ed6955426896f8bf5ec037f62d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.259346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ad67ed6955426896f8bf5ec037f62d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:33.262883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:33.295990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c07851-7e9f-4a4b-a2d4-37f7a1d8c3a4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:33.308251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:33.309146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.309435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.309736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] PATH_INFO: `/v3/users/30bf05081df24fe7b9098ca72bf99585` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.310957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30bf05081df24fe7b9098ca72bf99585)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:33.313629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:33.385954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ad67ed6955426896f8bf5ec037f62d', 'request_id': 'req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.387737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:33.467847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ad67ed6955426896f8bf5ec037f62d', 'request_id': 'req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.474034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ad67ed6955426896f8bf5ec037f62d', 'request_id': 'req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.485541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] The token cache is being invalidate because project 39ad67ed6955426896f8bf5ec037f62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:33.485828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.486516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4714a4f4-68b9-46a4-a585-e0ce3fefdc6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.488080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1026/2029] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:33 2022] DELETE /identity/v3/projects/39ad67ed6955426896f8bf5ec037f62d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:33.492707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ce311-a0fd-43ad-b036-75e737ef47f4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.493003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ce311-a0fd-43ad-b036-75e737ef47f4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.493282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ce311-a0fd-43ad-b036-75e737ef47f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.514323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d79ce311-a0fd-43ad-b036-75e737ef47f4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:33.515547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d79ce311-a0fd-43ad-b036-75e737ef47f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:33.515914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30bf05081df24fe7b9098ca72bf99585'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.516656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30bf05081df24fe7b9098ca72bf99585'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.529278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30bf05081df24fe7b9098ca72bf99585'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.537150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30bf05081df24fe7b9098ca72bf99585'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.573628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1027/2030] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:33.581215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07486d-2c61-4909-a3d1-2a3ee7954015 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.581510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07486d-2c61-4909-a3d1-2a3ee7954015 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.581793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07486d-2c61-4909-a3d1-2a3ee7954015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.597625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64b85bd3-519a-4bc1-8c58-e87df38172c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30bf05081df24fe7b9098ca72bf99585'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:33.602005 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5d07486d-2c61-4909-a3d1-2a3ee7954015 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:33.603257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5d07486d-2c61-4909-a3d1-2a3ee7954015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:33.608058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1004/2031] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:33 2022] DELETE /identity/v3/users/30bf05081df24fe7b9098ca72bf99585 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:33.610454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfa054-b50e-41c9-acdb-b540e115ec0d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.610751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfa054-b50e-41c9-acdb-b540e115ec0d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.611073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfa054-b50e-41c9-acdb-b540e115ec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.636399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-82dfa054-b50e-41c9-acdb-b540e115ec0d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:33.637751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-82dfa054-b50e-41c9-acdb-b540e115ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:33.659270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:33.678002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1028/2032] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:33.682205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07486d-2c61-4909-a3d1-2a3ee7954015 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:33.692294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07486d-2c61-4909-a3d1-2a3ee7954015 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:33.697089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664b9a7-0c62-49ac-994b-c22a6b526a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:33.698777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664b9a7-0c62-49ac-994b-c22a6b526a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.698777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664b9a7-0c62-49ac-994b-c22a6b526a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.698777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664b9a7-0c62-49ac-994b-c22a6b526a64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.699083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664b9a7-0c62-49ac-994b-c22a6b526a64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:33.699401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664b9a7-0c62-49ac-994b-c22a6b526a64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:33.700563 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1005/2033] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:33.701010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664b9a7-0c62-49ac-994b-c22a6b526a64 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:33.710650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfa054-b50e-41c9-acdb-b540e115ec0d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:33.714946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-82dfa054-b50e-41c9-acdb-b540e115ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:33.715379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1029/2034] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:33.724969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664b9a7-0c62-49ac-994b-c22a6b526a64 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:33.735595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664b9a7-0c62-49ac-994b-c22a6b526a64 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:33.740451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fe6ae-ea9e-41cb-a28e-8db51de06e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:33.741058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fe6ae-ea9e-41cb-a28e-8db51de06e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.741347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fe6ae-ea9e-41cb-a28e-8db51de06e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.741632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fe6ae-ea9e-41cb-a28e-8db51de06e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.742368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fe6ae-ea9e-41cb-a28e-8db51de06e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:33.746148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fe6ae-ea9e-41cb-a28e-8db51de06e07 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:33.777035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfa054-b50e-41c9-acdb-b540e115ec0d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:33.781372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e75b-adf9-4d10-b6ff-e72dbb2999db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:33.786994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e75b-adf9-4d10-b6ff-e72dbb2999db service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.786994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e75b-adf9-4d10-b6ff-e72dbb2999db service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.786994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7e75b-adf9-4d10-b6ff-e72dbb2999db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.794220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7e75b-adf9-4d10-b6ff-e72dbb2999db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:33.795715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7e75b-adf9-4d10-b6ff-e72dbb2999db service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:33.806332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1006/2035] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:33.844664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1030/2036] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:33 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:47:33.848641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e75b-adf9-4d10-b6ff-e72dbb2999db service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:33.858558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7e75b-adf9-4d10-b6ff-e72dbb2999db service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:33.917513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba6f58-edca-408b-b436-cdf8c4c0e326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:33.918296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba6f58-edca-408b-b436-cdf8c4c0e326 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.918577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba6f58-edca-408b-b436-cdf8c4c0e326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.918877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba6f58-edca-408b-b436-cdf8c4c0e326 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.919569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba6f58-edca-408b-b436-cdf8c4c0e326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:33.922319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba6f58-edca-408b-b436-cdf8c4c0e326 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:33.971341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fe6ae-ea9e-41cb-a28e-8db51de06e07 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:33.973139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-778fe6ae-ea9e-41cb-a28e-8db51de06e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:33.986081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fe6ae-ea9e-41cb-a28e-8db51de06e07 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:33.991265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:33.992148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:33.992433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:33.992714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] PATH_INFO: `/v3/users/d5ecc7f3d2ff4d2b873f274af38746b5` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:33.993922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5ecc7f3d2ff4d2b873f274af38746b5)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:33.995943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:34.045969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1007/2037] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:33 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:34.050222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba6f58-edca-408b-b436-cdf8c4c0e326 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:34.060545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba6f58-edca-408b-b436-cdf8c4c0e326 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:34.066309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f007-1fdf-4fa5-a0c6-7cb3212c2ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:34.067075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f007-1fdf-4fa5-a0c6-7cb3212c2ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.067362 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f007-1fdf-4fa5-a0c6-7cb3212c2ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.067645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350f007-1fdf-4fa5-a0c6-7cb3212c2ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.068380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f007-1fdf-4fa5-a0c6-7cb3212c2ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:34.070060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350f007-1fdf-4fa5-a0c6-7cb3212c2ee4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:34.081688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1008/2038] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:34.085661 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f007-1fdf-4fa5-a0c6-7cb3212c2ee4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:34.095893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350f007-1fdf-4fa5-a0c6-7cb3212c2ee4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:34.102043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95fbd9-bba3-4faf-87a0-8f3643e14c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:34.102712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95fbd9-bba3-4faf-87a0-8f3643e14c43 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.103030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95fbd9-bba3-4faf-87a0-8f3643e14c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.103316 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95fbd9-bba3-4faf-87a0-8f3643e14c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.104348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95fbd9-bba3-4faf-87a0-8f3643e14c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:34.109564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf95fbd9-bba3-4faf-87a0-8f3643e14c43 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:34.116280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1009/2039] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:34.122699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95fbd9-bba3-4faf-87a0-8f3643e14c43 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:34.133424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95fbd9-bba3-4faf-87a0-8f3643e14c43 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:34.140907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7221586-ad2e-464d-9312-3faedaa38175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:34.142089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7221586-ad2e-464d-9312-3faedaa38175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.142530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7221586-ad2e-464d-9312-3faedaa38175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.143159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7221586-ad2e-464d-9312-3faedaa38175 admin admin] PATH_INFO: `/v3/projects/aa1ef1e9737046dba161cf95d4b9c349/users/7e4de035baea4894b829a3b6e69efec9/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.161116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7221586-ad2e-464d-9312-3faedaa38175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1ef1e9737046dba161cf95d4b9c349, user_id=7e4de035baea4894b829a3b6e69efec9, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:34.163831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7221586-ad2e-464d-9312-3faedaa38175 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:34.188434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:34.194603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5ecc7f3d2ff4d2b873f274af38746b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.207531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5ecc7f3d2ff4d2b873f274af38746b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.270481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1010/2040] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:34 2022] PUT /identity/v3/projects/aa1ef1e9737046dba161cf95d4b9c349/users/7e4de035baea4894b829a3b6e69efec9/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:34.270481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7221586-ad2e-464d-9312-3faedaa38175 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:34.271889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d7221586-ad2e-464d-9312-3faedaa38175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.286900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:34.300759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5ecc7f3d2ff4d2b873f274af38746b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.304879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5ecc7f3d2ff4d2b873f274af38746b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.310409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0d091f19-a9e9-4760-bb00-ce3c9ab4f0d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5ecc7f3d2ff4d2b873f274af38746b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.318482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1031/2041] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:33 2022] DELETE /identity/v3/users/d5ecc7f3d2ff4d2b873f274af38746b5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:34.319818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cc21a-9c15-4823-83ee-9b17937d5a6f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.320113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cc21a-9c15-4823-83ee-9b17937d5a6f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.320402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cc21a-9c15-4823-83ee-9b17937d5a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.352242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7221586-ad2e-464d-9312-3faedaa38175 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:34.362578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-203cc21a-9c15-4823-83ee-9b17937d5a6f None None] MFA Rules not processed for user `7e4de035baea4894b829a3b6e69efec9`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:34.363851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-203cc21a-9c15-4823-83ee-9b17937d5a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.417777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:34.418590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.418903 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.419193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] PATH_INFO: `/v3/projects/d772160869694a658955329242565c46` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.420387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d772160869694a658955329242565c46)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:34.423131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:34.430136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1032/2042] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:34.431514 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1212ce7-d759-4f2f-85f5-29f868ad3c05 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.431819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1212ce7-d759-4f2f-85f5-29f868ad3c05 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.432093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1212ce7-d759-4f2f-85f5-29f868ad3c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.450728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c1212ce7-d759-4f2f-85f5-29f868ad3c05 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:34.452172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c1212ce7-d759-4f2f-85f5-29f868ad3c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.460670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1033/2043] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:34.461258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1212ce7-d759-4f2f-85f5-29f868ad3c05 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:34.462523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c1212ce7-d759-4f2f-85f5-29f868ad3c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.474692 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1212ce7-d759-4f2f-85f5-29f868ad3c05 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:34.479354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:34.480219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.480506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.480786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] PATH_INFO: `/v3/users/50739bd762fb48cea804b10e5b9d6e6e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.481981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50739bd762fb48cea804b10e5b9d6e6e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:34.484041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:34.550183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd772160869694a658955329242565c46', 'request_id': 'req-9747550a-6558-4e1b-afb7-fc603f6f5faf'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.555496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd772160869694a658955329242565c46', 'request_id': 'req-9747550a-6558-4e1b-afb7-fc603f6f5faf'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.648742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd772160869694a658955329242565c46', 'request_id': 'req-9747550a-6558-4e1b-afb7-fc603f6f5faf'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.660486 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] The token cache is being invalidate because project d772160869694a658955329242565c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:34.660790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.661421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.663013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1011/2044] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:34 2022] DELETE /identity/v3/projects/d772160869694a658955329242565c46 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:34.663792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:34.665088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.716735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50739bd762fb48cea804b10e5b9d6e6e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.717494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:34.728941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50739bd762fb48cea804b10e5b9d6e6e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.731537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747550a-6558-4e1b-afb7-fc603f6f5faf admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:34.736821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6caba-f64c-402f-a68d-4fd1b77948d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:34.737477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6caba-f64c-402f-a68d-4fd1b77948d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.737758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6caba-f64c-402f-a68d-4fd1b77948d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.738032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6caba-f64c-402f-a68d-4fd1b77948d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.738737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6caba-f64c-402f-a68d-4fd1b77948d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:34.740717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6caba-f64c-402f-a68d-4fd1b77948d8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:34.787784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50739bd762fb48cea804b10e5b9d6e6e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.788526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50739bd762fb48cea804b10e5b9d6e6e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.796089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50739bd762fb48cea804b10e5b9d6e6e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:34.802105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1034/2045] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:34 2022] DELETE /identity/v3/users/50739bd762fb48cea804b10e5b9d6e6e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:34.803017 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:34.804332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.820076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:34.828729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1012/2046] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:34 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:34.828729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6caba-f64c-402f-a68d-4fd1b77948d8 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:34.828729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7fb6caba-f64c-402f-a68d-4fd1b77948d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.876794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36285df-17bb-4f70-85bd-3f400cd19d1c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:34.891742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6caba-f64c-402f-a68d-4fd1b77948d8 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:34.897378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:34.898288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.898572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.898863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] PATH_INFO: `/v3/users/2f49d554860b40379fe9ed830a6ad3c0` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.900164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f49d554860b40379fe9ed830a6ad3c0)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:34.902132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:34.925428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023ea92-6c8b-461b-937a-a26cda76b404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:34.926082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023ea92-6c8b-461b-937a-a26cda76b404 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.926370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023ea92-6c8b-461b-937a-a26cda76b404 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.926673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023ea92-6c8b-461b-937a-a26cda76b404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.928593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4023ea92-6c8b-461b-937a-a26cda76b404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.940659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023ea92-6c8b-461b-937a-a26cda76b404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:34.942090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023ea92-6c8b-461b-937a-a26cda76b404 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:34.951642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1035/2047] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:34.954052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6667bb-7c6a-4257-ba99-a6a43936842b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:34.954342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6667bb-7c6a-4257-ba99-a6a43936842b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:34.954749 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6667bb-7c6a-4257-ba99-a6a43936842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:34.971415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9b6667bb-7c6a-4257-ba99-a6a43936842b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:34.972615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9b6667bb-7c6a-4257-ba99-a6a43936842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.980426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1036/2048] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:34.981307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6667bb-7c6a-4257-ba99-a6a43936842b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:34.983076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9b6667bb-7c6a-4257-ba99-a6a43936842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:34.996590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6667bb-7c6a-4257-ba99-a6a43936842b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:35.002465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8e940-5e0b-46be-8a80-5aa01d4c8881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:35.003152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8e940-5e0b-46be-8a80-5aa01d4c8881 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.003529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8e940-5e0b-46be-8a80-5aa01d4c8881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.003754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8e940-5e0b-46be-8a80-5aa01d4c8881 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.004452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8e940-5e0b-46be-8a80-5aa01d4c8881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:35.006389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8e940-5e0b-46be-8a80-5aa01d4c8881 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:35.086902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f49d554860b40379fe9ed830a6ad3c0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.087503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f49d554860b40379fe9ed830a6ad3c0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.099806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f49d554860b40379fe9ed830a6ad3c0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.106709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f49d554860b40379fe9ed830a6ad3c0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.110886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1037/2049] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:34 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:35.110886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8e940-5e0b-46be-8a80-5aa01d4c8881 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:35.114747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bad8e940-5e0b-46be-8a80-5aa01d4c8881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:35.126973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8e940-5e0b-46be-8a80-5aa01d4c8881 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:35.130696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:35.131376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.131693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.131972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.133759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:35.148782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:35.150214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:35.160154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1038/2050] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:35.161045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:35.162371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:35.176418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f49d554860b40379fe9ed830a6ad3c0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.181659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d1783-2837-455f-9059-7f1f629378c7 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:35.187503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1013/2051] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:34 2022] DELETE /identity/v3/users/2f49d554860b40379fe9ed830a6ad3c0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:35.191456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938e247-7749-4542-b3fd-df63263c2cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:35.192868 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938e247-7749-4542-b3fd-df63263c2cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.193309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938e247-7749-4542-b3fd-df63263c2cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.193737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938e247-7749-4542-b3fd-df63263c2cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.194699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938e247-7749-4542-b3fd-df63263c2cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:35.196354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938e247-7749-4542-b3fd-df63263c2cfb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:35.210655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1039/2052] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:35.217685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:35.287256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:35.293509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690e66d-6b6e-4baf-966e-1886a2cb17e3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:35.299105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c10d4-80a0-4906-b09d-a0005068f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:35.300199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c10d4-80a0-4906-b09d-a0005068f4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.300481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c10d4-80a0-4906-b09d-a0005068f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.300755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c10d4-80a0-4906-b09d-a0005068f4e8 admin admin] PATH_INFO: `/v3/projects/b03e0be217ea44289910748324db8638/users/ff936518f8414ca2bdaaaf32968962c6/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.328450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c10d4-80a0-4906-b09d-a0005068f4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03e0be217ea44289910748324db8638, user_id=ff936518f8414ca2bdaaaf32968962c6, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:35.331222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c10d4-80a0-4906-b09d-a0005068f4e8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:35.433431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1014/2053] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:35 2022] PUT /identity/v3/projects/b03e0be217ea44289910748324db8638/users/ff936518f8414ca2bdaaaf32968962c6/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:35.437716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938e247-7749-4542-b3fd-df63263c2cfb admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:35.449059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938e247-7749-4542-b3fd-df63263c2cfb admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:35.518083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57015e7-fa40-4688-ae7a-87940e40ca7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:35.518763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57015e7-fa40-4688-ae7a-87940e40ca7c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.519096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57015e7-fa40-4688-ae7a-87940e40ca7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.519377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57015e7-fa40-4688-ae7a-87940e40ca7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.520107 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57015e7-fa40-4688-ae7a-87940e40ca7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:35.521785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57015e7-fa40-4688-ae7a-87940e40ca7c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:35.531913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1040/2054] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:35.536255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c10d4-80a0-4906-b09d-a0005068f4e8 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:35.547663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c10d4-80a0-4906-b09d-a0005068f4e8 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:35.559272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821a9a3-6f65-4cae-ba07-f12f68feb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:35.565590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a9a3-6f65-4cae-ba07-f12f68feb66a admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.565590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a9a3-6f65-4cae-ba07-f12f68feb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.565590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a9a3-6f65-4cae-ba07-f12f68feb66a admin admin] PATH_INFO: `/v3/projects/b03e0be217ea44289910748324db8638/users/ff936518f8414ca2bdaaaf32968962c6/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.567951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821a9a3-6f65-4cae-ba07-f12f68feb66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03e0be217ea44289910748324db8638, user_id=ff936518f8414ca2bdaaaf32968962c6, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:35.571293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821a9a3-6f65-4cae-ba07-f12f68feb66a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:35.583790 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1015/2055] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:35 2022] PUT /identity/v3/projects/b03e0be217ea44289910748324db8638/users/ff936518f8414ca2bdaaaf32968962c6/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:35.602464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9902-92b7-4bc3-8193-e301537fd56e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.602464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9902-92b7-4bc3-8193-e301537fd56e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.602464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae9902-92b7-4bc3-8193-e301537fd56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.604684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821a9a3-6f65-4cae-ba07-f12f68feb66a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:35.606670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d821a9a3-6f65-4cae-ba07-f12f68feb66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:35.634619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-79ae9902-92b7-4bc3-8193-e301537fd56e None None] MFA Rules not processed for user `ff936518f8414ca2bdaaaf32968962c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:35.636146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-79ae9902-92b7-4bc3-8193-e301537fd56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:35.644325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:35.715127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821a9a3-6f65-4cae-ba07-f12f68feb66a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:35.723308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:35.724894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.725259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.725775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] PATH_INFO: `/v3/projects/244c1110cf294e4db84cfd634176a050` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.727127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=244c1110cf294e4db84cfd634176a050)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:35.729926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:35.739097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1041/2056] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:35.752410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9902-92b7-4bc3-8193-e301537fd56e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:35.753925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-79ae9902-92b7-4bc3-8193-e301537fd56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:35.820880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae9902-92b7-4bc3-8193-e301537fd56e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:35.824586 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb6b43-c92d-4e89-993c-afee58ab781d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:35.825234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6b43-c92d-4e89-993c-afee58ab781d service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.825522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6b43-c92d-4e89-993c-afee58ab781d service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.825822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb6b43-c92d-4e89-993c-afee58ab781d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.835857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb6b43-c92d-4e89-993c-afee58ab781d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:35.837290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb6b43-c92d-4e89-993c-afee58ab781d service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:35.851297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1042/2057] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:35.852336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb6b43-c92d-4e89-993c-afee58ab781d service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:35.853638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fddb6b43-c92d-4e89-993c-afee58ab781d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:35.870469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb6b43-c92d-4e89-993c-afee58ab781d service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:35.877427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244c1110cf294e4db84cfd634176a050', 'request_id': 'req-06d41391-4d74-464d-8d33-bd338cb736b4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.878296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244c1110cf294e4db84cfd634176a050', 'request_id': 'req-06d41391-4d74-464d-8d33-bd338cb736b4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.934139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:35.935348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:35.935644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:35.935945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] PATH_INFO: `/v3/projects/a8817dedfbef42138671178aa20908eb` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:35.937175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8817dedfbef42138671178aa20908eb)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:35.939153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:35.965300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244c1110cf294e4db84cfd634176a050', 'request_id': 'req-06d41391-4d74-464d-8d33-bd338cb736b4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.978628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] The token cache is being invalidate because project 244c1110cf294e4db84cfd634176a050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:35.978958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.979621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:35.981187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1016/2058] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:35 2022] DELETE /identity/v3/projects/244c1110cf294e4db84cfd634176a050 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:35.984367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:35.984367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:35.995763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d41391-4d74-464d-8d33-bd338cb736b4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:36.000492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:36.001341 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:36.001627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:36.001905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] PATH_INFO: `/v3/projects/d389db21323c40d7adb245a3bf6b791d` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:36.003115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d389db21323c40d7adb245a3bf6b791d)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:36.005006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:36.068243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8817dedfbef42138671178aa20908eb', 'request_id': 'req-bbfd0fd0-461b-4c44-a130-5de3d80503d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.140746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd389db21323c40d7adb245a3bf6b791d', 'request_id': 'req-37af163b-60aa-4fef-a3a4-76fd57992e6d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.141931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:36.146617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd389db21323c40d7adb245a3bf6b791d', 'request_id': 'req-37af163b-60aa-4fef-a3a4-76fd57992e6d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.150582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8817dedfbef42138671178aa20908eb', 'request_id': 'req-bbfd0fd0-461b-4c44-a130-5de3d80503d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.156751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8817dedfbef42138671178aa20908eb', 'request_id': 'req-bbfd0fd0-461b-4c44-a130-5de3d80503d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.167754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] The token cache is being invalidate because project a8817dedfbef42138671178aa20908eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:36.168039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.168683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.170479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1043/2059] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:35 2022] DELETE /identity/v3/projects/a8817dedfbef42138671178aa20908eb => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:36.172508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:36.173835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:36.220249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:36.239053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd0fd0-461b-4c44-a130-5de3d80503d4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:36.262254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd389db21323c40d7adb245a3bf6b791d', 'request_id': 'req-37af163b-60aa-4fef-a3a4-76fd57992e6d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.274699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] The token cache is being invalidate because project d389db21323c40d7adb245a3bf6b791d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:36.275039 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.275696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.277348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1017/2060] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:35 2022] DELETE /identity/v3/projects/d389db21323c40d7adb245a3bf6b791d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:36.278111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:36.279405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:36.297522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:36.298442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:36.298728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:36.299072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] PATH_INFO: `/v3/users/6c391a99e9d74cd1867f29b1dbe811a4` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:36.300324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c391a99e9d74cd1867f29b1dbe811a4)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:36.302410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:36.337159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af163b-60aa-4fef-a3a4-76fd57992e6d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:36.340753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:36.341968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:36.342423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:36.343129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:36.344956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:36.404431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:36.406487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:36.415695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1018/2061] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:36.418150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:36.419516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:36.432832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c156fc-21db-4b57-b152-d3acc39f3bc2 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:36.438241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:36.439134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:36.439420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:36.439700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] PATH_INFO: `/v3/users/1f9abff222e244bd83ec0c8abb064397` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:36.441188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f9abff222e244bd83ec0c8abb064397)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:36.443123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:36.499146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c391a99e9d74cd1867f29b1dbe811a4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.511830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c391a99e9d74cd1867f29b1dbe811a4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.591442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c391a99e9d74cd1867f29b1dbe811a4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.592161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c391a99e9d74cd1867f29b1dbe811a4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.602292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c391a99e9d74cd1867f29b1dbe811a4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.609267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1044/2062] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:36 2022] DELETE /identity/v3/users/6c391a99e9d74cd1867f29b1dbe811a4 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:36.610460 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:36.612432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:36.684605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6572c-cd59-4d15-b072-4b7600a94089 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:36.690241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:36.691439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:36.692014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:36.692014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] PATH_INFO: `/v3/users/0a8c705656b548e781faccb0343b8574` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:36.693397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8c705656b548e781faccb0343b8574)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:36.695743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:36.743509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f9abff222e244bd83ec0c8abb064397'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.744244 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f9abff222e244bd83ec0c8abb064397'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.756704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f9abff222e244bd83ec0c8abb064397'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.763625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f9abff222e244bd83ec0c8abb064397'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.821508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:36.905093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f9abff222e244bd83ec0c8abb064397'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.912125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1019/2063] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:36 2022] DELETE /identity/v3/users/1f9abff222e244bd83ec0c8abb064397 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:36.955929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8c705656b548e781faccb0343b8574'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:36.969078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8c705656b548e781faccb0343b8574'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.082171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8c705656b548e781faccb0343b8574'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.084088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8c705656b548e781faccb0343b8574'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.093974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8c705656b548e781faccb0343b8574'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.100840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1045/2064] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:36 2022] DELETE /identity/v3/users/0a8c705656b548e781faccb0343b8574 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:37.154510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:37.157033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:37.163813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:37.246233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e8aea-9f6e-4ec5-84f4-d49cee638c93 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:37.321750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:37.322635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:37.322948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:37.323277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] PATH_INFO: `/v3/projects/5c909735438f471b8f9cf421da5a5193` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:37.324527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c909735438f471b8f9cf421da5a5193)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:37.326463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:37.469544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c909735438f471b8f9cf421da5a5193', 'request_id': 'req-795bc57e-cc44-47f4-b704-c400d2373d42'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.475203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c909735438f471b8f9cf421da5a5193', 'request_id': 'req-795bc57e-cc44-47f4-b704-c400d2373d42'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.511760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:37.513200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:37.528239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a59eb-0d0b-4e1c-8bee-147c71f278d0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:37.585198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c909735438f471b8f9cf421da5a5193', 'request_id': 'req-795bc57e-cc44-47f4-b704-c400d2373d42'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.590596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:37.591495 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:37.591791 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:37.592045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] PATH_INFO: `/v3/projects/b048ba18e8d84b7d9ec63de1b3a115fd` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:37.595364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b048ba18e8d84b7d9ec63de1b3a115fd)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:37.595917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:37.599071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] The token cache is being invalidate because project 5c909735438f471b8f9cf421da5a5193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:37.599494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.600260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-795bc57e-cc44-47f4-b704-c400d2373d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.601893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1020/2065] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:37 2022] DELETE /identity/v3/projects/5c909735438f471b8f9cf421da5a5193 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:37.606389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e1e62-3b4a-4212-b13f-285293cd6a96 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:37.606810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e1e62-3b4a-4212-b13f-285293cd6a96 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:37.607210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e1e62-3b4a-4212-b13f-285293cd6a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:37.631144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2d8e1e62-3b4a-4212-b13f-285293cd6a96 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:37.632369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2d8e1e62-3b4a-4212-b13f-285293cd6a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:37.641250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1021/2066] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:37.642456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e1e62-3b4a-4212-b13f-285293cd6a96 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:37.651653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2d8e1e62-3b4a-4212-b13f-285293cd6a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:37.656517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e1e62-3b4a-4212-b13f-285293cd6a96 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:37.661493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:37.662353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:37.662664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:37.662972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] PATH_INFO: `/v3/projects/799b488b457d49e08cc19ae5a5212f4a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:37.664259 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=799b488b457d49e08cc19ae5a5212f4a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:37.666199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:37.702824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b048ba18e8d84b7d9ec63de1b3a115fd', 'request_id': 'req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.800904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799b488b457d49e08cc19ae5a5212f4a', 'request_id': 'req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.806900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799b488b457d49e08cc19ae5a5212f4a', 'request_id': 'req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.810922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b048ba18e8d84b7d9ec63de1b3a115fd', 'request_id': 'req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.817753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b048ba18e8d84b7d9ec63de1b3a115fd', 'request_id': 'req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.829668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] The token cache is being invalidate because project b048ba18e8d84b7d9ec63de1b3a115fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:37.829957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.830600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5c5cbeb7-2091-46f3-b6b1-0bf1d5e262ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.832245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1046/2067] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:37 2022] DELETE /identity/v3/projects/b048ba18e8d84b7d9ec63de1b3a115fd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:37.834977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d040-b7c0-4d67-9082-fd2704d0af7e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:37.834977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d040-b7c0-4d67-9082-fd2704d0af7e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:37.834977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d040-b7c0-4d67-9082-fd2704d0af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:37.853750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7bf7d040-b7c0-4d67-9082-fd2704d0af7e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:37.861955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7bf7d040-b7c0-4d67-9082-fd2704d0af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:37.913786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799b488b457d49e08cc19ae5a5212f4a', 'request_id': 'req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.919257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1047/2068] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:37.920860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c45ef-be36-4b2d-88b3-87896ffa68f9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:37.921891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c45ef-be36-4b2d-88b3-87896ffa68f9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:37.929774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c45ef-be36-4b2d-88b3-87896ffa68f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:37.929893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] The token cache is being invalidate because project 799b488b457d49e08cc19ae5a5212f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:37.929893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.929893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:37.929893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1022/2069] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:37 2022] DELETE /identity/v3/projects/799b488b457d49e08cc19ae5a5212f4a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:37.932083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:37.932214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:37.933576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:37.943441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a92c45ef-be36-4b2d-88b3-87896ffa68f9 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:37.944641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a92c45ef-be36-4b2d-88b3-87896ffa68f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:37.946459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800dd972-a4b2-49e9-9ca7-2385d8ab6a25 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:37.951303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b01d78-2127-468c-ae67-d4cf4047b614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:37.951997 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b01d78-2127-468c-ae67-d4cf4047b614 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:37.952286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b01d78-2127-468c-ae67-d4cf4047b614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:37.953003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b01d78-2127-468c-ae67-d4cf4047b614 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:37.953134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1048/2070] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:37.953367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b01d78-2127-468c-ae67-d4cf4047b614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:37.953678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b01d78-2127-468c-ae67-d4cf4047b614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:37.953843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c45ef-be36-4b2d-88b3-87896ffa68f9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:37.955335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b01d78-2127-468c-ae67-d4cf4047b614 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:37.960207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a92c45ef-be36-4b2d-88b3-87896ffa68f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:37.970557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1023/2071] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:37.970557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f3e1d-5367-4080-964e-58adc7608e54 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:37.970557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f3e1d-5367-4080-964e-58adc7608e54 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:37.970557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f3e1d-5367-4080-964e-58adc7608e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:37.973529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c45ef-be36-4b2d-88b3-87896ffa68f9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:37.979376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:37.980257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:37.980543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:37.980824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] PATH_INFO: `/v3/users/307c904fbf624c4faa7165cac04e1616` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:37.982039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=307c904fbf624c4faa7165cac04e1616)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:37.984863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:37.989153 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-976f3e1d-5367-4080-964e-58adc7608e54 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:37.990365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-976f3e1d-5367-4080-964e-58adc7608e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:37.998332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1024/2072] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:38.004289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f3e1d-5367-4080-964e-58adc7608e54 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.008536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f3e1d-5367-4080-964e-58adc7608e54 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.013144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d234-809f-4a76-a9a7-ae74d65c6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.014045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d234-809f-4a76-a9a7-ae74d65c6629 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.014331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d234-809f-4a76-a9a7-ae74d65c6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.014621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715d234-809f-4a76-a9a7-ae74d65c6629 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.015982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715d234-809f-4a76-a9a7-ae74d65c6629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.017965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715d234-809f-4a76-a9a7-ae74d65c6629 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.144589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1025/2073] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:37 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:38.145429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d234-809f-4a76-a9a7-ae74d65c6629 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.208067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715d234-809f-4a76-a9a7-ae74d65c6629 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.213957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae574-c9e0-4e96-93a6-ccc2713a7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.215023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae574-c9e0-4e96-93a6-ccc2713a7885 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.215307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae574-c9e0-4e96-93a6-ccc2713a7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.215694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ae574-c9e0-4e96-93a6-ccc2713a7885 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.215877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307c904fbf624c4faa7165cac04e1616'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:38.216424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ae574-c9e0-4e96-93a6-ccc2713a7885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:38.216733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ae574-c9e0-4e96-93a6-ccc2713a7885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.218955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ae574-c9e0-4e96-93a6-ccc2713a7885 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.228430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307c904fbf624c4faa7165cac04e1616'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:38.231108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1026/2074] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:38.231915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae574-c9e0-4e96-93a6-ccc2713a7885 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.242118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ae574-c9e0-4e96-93a6-ccc2713a7885 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.246864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d17799-b2a6-40db-95a1-beefd07074dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.247502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d17799-b2a6-40db-95a1-beefd07074dd admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.247786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d17799-b2a6-40db-95a1-beefd07074dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.248063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d17799-b2a6-40db-95a1-beefd07074dd admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.248791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d17799-b2a6-40db-95a1-beefd07074dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.251269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d17799-b2a6-40db-95a1-beefd07074dd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.336771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307c904fbf624c4faa7165cac04e1616'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:38.337386 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307c904fbf624c4faa7165cac04e1616'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:38.345709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307c904fbf624c4faa7165cac04e1616'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:38.351703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1049/2075] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:37 2022] DELETE /identity/v3/users/307c904fbf624c4faa7165cac04e1616 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:38.352464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.353797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:38.371541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1027/2076] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:38 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:38.376351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d17799-b2a6-40db-95a1-beefd07074dd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.378567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-23d17799-b2a6-40db-95a1-beefd07074dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:38.393129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d17799-b2a6-40db-95a1-beefd07074dd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.424626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295dbcd-ce56-40ba-ba95-7995ccfa06b1 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.429615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d878412-96e3-4ee4-8209-e7469351ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.430277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878412-96e3-4ee4-8209-e7469351ea64 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.430562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878412-96e3-4ee4-8209-e7469351ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.430864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d878412-96e3-4ee4-8209-e7469351ea64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.431577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d878412-96e3-4ee4-8209-e7469351ea64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.433878 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d878412-96e3-4ee4-8209-e7469351ea64 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.457161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa54c5-f643-47d3-acc5-6c9d91ad926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.458221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa54c5-f643-47d3-acc5-6c9d91ad926b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.458515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa54c5-f643-47d3-acc5-6c9d91ad926b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.458794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa54c5-f643-47d3-acc5-6c9d91ad926b admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.459564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa54c5-f643-47d3-acc5-6c9d91ad926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.461268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa54c5-f643-47d3-acc5-6c9d91ad926b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.471262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1028/2077] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:38.475213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa54c5-f643-47d3-acc5-6c9d91ad926b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.485401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa54c5-f643-47d3-acc5-6c9d91ad926b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.489952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bdda3-60d4-4ae8-b6f3-5351c03c5d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.490779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bdda3-60d4-4ae8-b6f3-5351c03c5d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.491264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bdda3-60d4-4ae8-b6f3-5351c03c5d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.492692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:38.493142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bdda3-60d4-4ae8-b6f3-5351c03c5d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.493908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bdda3-60d4-4ae8-b6f3-5351c03c5d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.495572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bdda3-60d4-4ae8-b6f3-5351c03c5d93 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.506461 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1029/2078] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:38.510530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bdda3-60d4-4ae8-b6f3-5351c03c5d93 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.529205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bdda3-60d4-4ae8-b6f3-5351c03c5d93 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.529430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1050/2079] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:38 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:38.529978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b6d5ee-7253-438d-9c7c-b223897a2432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.529978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d5ee-7253-438d-9c7c-b223897a2432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.529978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d5ee-7253-438d-9c7c-b223897a2432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.529978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b6d5ee-7253-438d-9c7c-b223897a2432 admin admin] PATH_INFO: `/v3/projects/89102621a80c4891b20d323c45187886/users/1438e192e4f640819b0e755049339749/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.532099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d878412-96e3-4ee4-8209-e7469351ea64 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.546874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d5ee-7253-438d-9c7c-b223897a2432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89102621a80c4891b20d323c45187886, user_id=1438e192e4f640819b0e755049339749, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.549691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b6d5ee-7253-438d-9c7c-b223897a2432 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.600451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d878412-96e3-4ee4-8209-e7469351ea64 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.605360 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04c799-974c-4ca0-ad70-033420a205bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.606035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04c799-974c-4ca0-ad70-033420a205bc admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.606330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04c799-974c-4ca0-ad70-033420a205bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.606716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04c799-974c-4ca0-ad70-033420a205bc admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.607455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04c799-974c-4ca0-ad70-033420a205bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.609720 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04c799-974c-4ca0-ad70-033420a205bc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.633701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1030/2080] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:38 2022] PUT /identity/v3/projects/89102621a80c4891b20d323c45187886/users/1438e192e4f640819b0e755049339749/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:38.650552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69965eb-1a2b-4136-bcd8-43bf84d60021 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.650871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69965eb-1a2b-4136-bcd8-43bf84d60021 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.651158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69965eb-1a2b-4136-bcd8-43bf84d60021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.677161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c69965eb-1a2b-4136-bcd8-43bf84d60021 None None] MFA Rules not processed for user `1438e192e4f640819b0e755049339749`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:38.678391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c69965eb-1a2b-4136-bcd8-43bf84d60021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:38.725859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1051/2081] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:38 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:38.727258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04c799-974c-4ca0-ad70-033420a205bc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.737536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04c799-974c-4ca0-ad70-033420a205bc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.743050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1031/2082] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:38.747469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69965eb-1a2b-4136-bcd8-43bf84d60021 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.800375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a218f2-2b64-4867-b5e0-31caf56777e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.800946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a218f2-2b64-4867-b5e0-31caf56777e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.801286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a218f2-2b64-4867-b5e0-31caf56777e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.801560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a218f2-2b64-4867-b5e0-31caf56777e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.802316 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a218f2-2b64-4867-b5e0-31caf56777e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.803974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a218f2-2b64-4867-b5e0-31caf56777e2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.814159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69965eb-1a2b-4136-bcd8-43bf84d60021 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.816138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1052/2083] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:38.817030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a218f2-2b64-4867-b5e0-31caf56777e2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.818798 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-24a218f2-2b64-4867-b5e0-31caf56777e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:38.823095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1e7a-5592-4d50-b2d5-23f5f39a7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.823767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1e7a-5592-4d50-b2d5-23f5f39a7f47 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.824085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1e7a-5592-4d50-b2d5-23f5f39a7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.829086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1e7a-5592-4d50-b2d5-23f5f39a7f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.829086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1e7a-5592-4d50-b2d5-23f5f39a7f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.829086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1e7a-5592-4d50-b2d5-23f5f39a7f47 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.831414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a218f2-2b64-4867-b5e0-31caf56777e2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:38.836479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:38.837337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:38.837853 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:38.838147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] PATH_INFO: `/v3/projects/d72b7e748cfd49c1b4e7411e8e590b7f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:38.839371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72b7e748cfd49c1b4e7411e8e590b7f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:38.841469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:38.912364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1032/2084] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:38 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:38.913200 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1e7a-5592-4d50-b2d5-23f5f39a7f47 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:38.953946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72b7e748cfd49c1b4e7411e8e590b7f', 'request_id': 'req-03062b2e-33fa-440c-9831-e6792b37619d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:38.980274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1e7a-5592-4d50-b2d5-23f5f39a7f47 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.039428 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57315bed-1798-482a-9bb1-4dcda6eb9a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.040028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57315bed-1798-482a-9bb1-4dcda6eb9a81 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.040320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57315bed-1798-482a-9bb1-4dcda6eb9a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.040603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57315bed-1798-482a-9bb1-4dcda6eb9a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.041336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57315bed-1798-482a-9bb1-4dcda6eb9a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.043172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57315bed-1798-482a-9bb1-4dcda6eb9a81 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.053662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1033/2085] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:39.054293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57315bed-1798-482a-9bb1-4dcda6eb9a81 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.056211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72b7e748cfd49c1b4e7411e8e590b7f', 'request_id': 'req-03062b2e-33fa-440c-9831-e6792b37619d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:39.063101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72b7e748cfd49c1b4e7411e8e590b7f', 'request_id': 'req-03062b2e-33fa-440c-9831-e6792b37619d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:39.066660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57315bed-1798-482a-9bb1-4dcda6eb9a81 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.073235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97869036-7df8-4670-9def-62d835c642d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.073909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869036-7df8-4670-9def-62d835c642d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.074199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869036-7df8-4670-9def-62d835c642d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.074478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97869036-7df8-4670-9def-62d835c642d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.075320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97869036-7df8-4670-9def-62d835c642d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.077092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] The token cache is being invalidate because project d72b7e748cfd49c1b4e7411e8e590b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:39.077212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97869036-7df8-4670-9def-62d835c642d8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.078055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:39.079019 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:39.085735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1053/2086] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:38 2022] DELETE /identity/v3/projects/d72b7e748cfd49c1b4e7411e8e590b7f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:39.085735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.086935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:39.100171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03062b2e-33fa-440c-9831-e6792b37619d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.104783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9ac4-00e9-4fed-9a39-e0aa6354f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.105668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9ac4-00e9-4fed-9a39-e0aa6354f0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.105954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9ac4-00e9-4fed-9a39-e0aa6354f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.106230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe9ac4-00e9-4fed-9a39-e0aa6354f0e5 admin admin] PATH_INFO: `/v3/projects/5e8e9ffc656e4ff992cc950ddd910e89/users/209eda5fdbe145969bf307c8ebe3cb23/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.121699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe9ac4-00e9-4fed-9a39-e0aa6354f0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8e9ffc656e4ff992cc950ddd910e89, user_id=209eda5fdbe145969bf307c8ebe3cb23, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.125050 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe9ac4-00e9-4fed-9a39-e0aa6354f0e5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.146891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1034/2087] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:39 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:39.148203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104ebc3-f7bb-4bbe-b8b7-4ec963c176e5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.150897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104ebc3-f7bb-4bbe-b8b7-4ec963c176e5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.150897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104ebc3-f7bb-4bbe-b8b7-4ec963c176e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.166152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3104ebc3-f7bb-4bbe-b8b7-4ec963c176e5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:39.167394 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3104ebc3-f7bb-4bbe-b8b7-4ec963c176e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:39.175675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1035/2088] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:39.176426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104ebc3-f7bb-4bbe-b8b7-4ec963c176e5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.177601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3104ebc3-f7bb-4bbe-b8b7-4ec963c176e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:39.189494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104ebc3-f7bb-4bbe-b8b7-4ec963c176e5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.194017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e2a9f-e0b4-4688-8a61-0b4b0b794877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.194648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e2a9f-e0b4-4688-8a61-0b4b0b794877 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.194970 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e2a9f-e0b4-4688-8a61-0b4b0b794877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.195246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e2a9f-e0b4-4688-8a61-0b4b0b794877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.195956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e2a9f-e0b4-4688-8a61-0b4b0b794877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.197597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e2a9f-e0b4-4688-8a61-0b4b0b794877 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.208054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1036/2089] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:39.209233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe0115-e90e-42c9-bf67-02e8223e4755 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.209522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe0115-e90e-42c9-bf67-02e8223e4755 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.209801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe0115-e90e-42c9-bf67-02e8223e4755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.227250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fffe0115-e90e-42c9-bf67-02e8223e4755 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:39.228245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1054/2090] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:39 2022] PUT /identity/v3/projects/5e8e9ffc656e4ff992cc950ddd910e89/users/209eda5fdbe145969bf307c8ebe3cb23/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:39.228490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fffe0115-e90e-42c9-bf67-02e8223e4755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:39.229178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9ac4-00e9-4fed-9a39-e0aa6354f0e5 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.302162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1037/2091] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:39.303522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0cc65-92a2-4615-881c-e59759a264f8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.303814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0cc65-92a2-4615-881c-e59759a264f8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.304092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0cc65-92a2-4615-881c-e59759a264f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.304192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe9ac4-00e9-4fed-9a39-e0aa6354f0e5 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.309513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16148db-13d7-4bc0-ac0b-d0bda45608bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.310421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16148db-13d7-4bc0-ac0b-d0bda45608bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.310706 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16148db-13d7-4bc0-ac0b-d0bda45608bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.311018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16148db-13d7-4bc0-ac0b-d0bda45608bf admin admin] PATH_INFO: `/v3/projects/81fbd6948c804fe38d1aa0506ab302d2/users/3f27303678c54f8f9e38a1ec0cc7993f/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.327295 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16148db-13d7-4bc0-ac0b-d0bda45608bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fbd6948c804fe38d1aa0506ab302d2, user_id=3f27303678c54f8f9e38a1ec0cc7993f, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.333347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16148db-13d7-4bc0-ac0b-d0bda45608bf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.337904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6fa0cc65-92a2-4615-881c-e59759a264f8 None None] MFA Rules not processed for user `209eda5fdbe145969bf307c8ebe3cb23`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:39.337904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6fa0cc65-92a2-4615-881c-e59759a264f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:39.341542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:39.426891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1038/2092] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:39.427850 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0cc65-92a2-4615-881c-e59759a264f8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.448585 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0cc65-92a2-4615-881c-e59759a264f8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.457529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.457777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.458067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.458349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.459126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:39.459433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.461086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.474513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1039/2093] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:39.475483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.477380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:39.543137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb2c2d-3769-4391-afa2-a42e0c4d3bfc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.547227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fbd8-86b2-40b1-93ce-0fbe152eca37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.547875 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fbd8-86b2-40b1-93ce-0fbe152eca37 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.548159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fbd8-86b2-40b1-93ce-0fbe152eca37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.548436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fbd8-86b2-40b1-93ce-0fbe152eca37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.556764 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9fbd8-86b2-40b1-93ce-0fbe152eca37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.558201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9fbd8-86b2-40b1-93ce-0fbe152eca37 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.568233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1040/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:39.570255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fbd8-86b2-40b1-93ce-0fbe152eca37 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.581715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fbd8-86b2-40b1-93ce-0fbe152eca37 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.586746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f087b-3db2-4ac9-bb7b-7d5683c564a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.588717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f087b-3db2-4ac9-bb7b-7d5683c564a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.588717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f087b-3db2-4ac9-bb7b-7d5683c564a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.588717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f087b-3db2-4ac9-bb7b-7d5683c564a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.588979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f087b-3db2-4ac9-bb7b-7d5683c564a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.590917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f087b-3db2-4ac9-bb7b-7d5683c564a4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.714148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1055/2095] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:39 2022] PUT /identity/v3/projects/81fbd6948c804fe38d1aa0506ab302d2/users/3f27303678c54f8f9e38a1ec0cc7993f/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:39.715044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16148db-13d7-4bc0-ac0b-d0bda45608bf admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.743276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1041/2096] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:39 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:39.743276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f087b-3db2-4ac9-bb7b-7d5683c564a4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.780070 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16148db-13d7-4bc0-ac0b-d0bda45608bf admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.806440 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f087b-3db2-4ac9-bb7b-7d5683c564a4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.811527 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef53949-8a9d-400b-9bce-e0567c0c3393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.813905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef53949-8a9d-400b-9bce-e0567c0c3393 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.813905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef53949-8a9d-400b-9bce-e0567c0c3393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.813905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef53949-8a9d-400b-9bce-e0567c0c3393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.814235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef53949-8a9d-400b-9bce-e0567c0c3393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.815951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef53949-8a9d-400b-9bce-e0567c0c3393 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.825843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1042/2097] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:39.826703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef53949-8a9d-400b-9bce-e0567c0c3393 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.836969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef53949-8a9d-400b-9bce-e0567c0c3393 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.838521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.839565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.847779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.847779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] PATH_INFO: `/v3/users/209eda5fdbe145969bf307c8ebe3cb23` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.847779 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209eda5fdbe145969bf307c8ebe3cb23)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.848207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c18ab-1775-4e3a-bb54-adcaea824721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.848207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c18ab-1775-4e3a-bb54-adcaea824721 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.848207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c18ab-1775-4e3a-bb54-adcaea824721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.848207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c18ab-1775-4e3a-bb54-adcaea824721 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.848538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.848627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c18ab-1775-4e3a-bb54-adcaea824721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.848627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c18ab-1775-4e3a-bb54-adcaea824721 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.891595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:39.948173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1043/2098] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:39 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:39.951662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c18ab-1775-4e3a-bb54-adcaea824721 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:39.959738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c18ab-1775-4e3a-bb54-adcaea824721 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:39.964376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f092f8b-1a03-4cdf-a520-ec8d770ad092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:39.965242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f092f8b-1a03-4cdf-a520-ec8d770ad092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:39.965524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f092f8b-1a03-4cdf-a520-ec8d770ad092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:39.965799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f092f8b-1a03-4cdf-a520-ec8d770ad092 admin admin] PATH_INFO: `/v3/projects/81fbd6948c804fe38d1aa0506ab302d2/users/3f27303678c54f8f9e38a1ec0cc7993f/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:39.967780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f092f8b-1a03-4cdf-a520-ec8d770ad092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fbd6948c804fe38d1aa0506ab302d2, user_id=3f27303678c54f8f9e38a1ec0cc7993f, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:39.970504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f092f8b-1a03-4cdf-a520-ec8d770ad092 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:39.981956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1044/2099] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:39 2022] PUT /identity/v3/projects/81fbd6948c804fe38d1aa0506ab302d2/users/3f27303678c54f8f9e38a1ec0cc7993f/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:39.983158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f092f8b-1a03-4cdf-a520-ec8d770ad092 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:40.048305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f092f8b-1a03-4cdf-a520-ec8d770ad092 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:40.053059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8829e-3458-4f35-b7dd-14269c7ae713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:40.053720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8829e-3458-4f35-b7dd-14269c7ae713 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.054007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8829e-3458-4f35-b7dd-14269c7ae713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.054287 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8829e-3458-4f35-b7dd-14269c7ae713 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.055110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8829e-3458-4f35-b7dd-14269c7ae713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:40.056768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8829e-3458-4f35-b7dd-14269c7ae713 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:40.067052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1045/2100] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:40.068304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1caa24-9eb2-4770-8873-17a2c0cae85e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.068599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1caa24-9eb2-4770-8873-17a2c0cae85e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.068885 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1caa24-9eb2-4770-8873-17a2c0cae85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.088535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209eda5fdbe145969bf307c8ebe3cb23'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.100358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3a1caa24-9eb2-4770-8873-17a2c0cae85e None None] MFA Rules not processed for user `3f27303678c54f8f9e38a1ec0cc7993f`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:40.102294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3a1caa24-9eb2-4770-8873-17a2c0cae85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:40.104262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209eda5fdbe145969bf307c8ebe3cb23'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.183236 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1046/2101] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:40.188889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1caa24-9eb2-4770-8873-17a2c0cae85e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:40.199314 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209eda5fdbe145969bf307c8ebe3cb23'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.200154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209eda5fdbe145969bf307c8ebe3cb23'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.205310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1caa24-9eb2-4770-8873-17a2c0cae85e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:40.210257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209eda5fdbe145969bf307c8ebe3cb23'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.210407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5d04b-12fd-42dc-ac9f-a5a602293c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:40.211322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5d04b-12fd-42dc-ac9f-a5a602293c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.211613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5d04b-12fd-42dc-ac9f-a5a602293c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.211900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5d04b-12fd-42dc-ac9f-a5a602293c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.212726 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5d04b-12fd-42dc-ac9f-a5a602293c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:40.214355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5d04b-12fd-42dc-ac9f-a5a602293c41 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:40.221992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1056/2102] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:39 2022] DELETE /identity/v3/users/209eda5fdbe145969bf307c8ebe3cb23 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:40.223341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:40.226946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:40.232825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1047/2103] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:40.232825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe17b4e-5367-4d3d-9183-d5d152524966 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.232825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe17b4e-5367-4d3d-9183-d5d152524966 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.232825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe17b4e-5367-4d3d-9183-d5d152524966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.250758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bbe17b4e-5367-4d3d-9183-d5d152524966 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:40.252763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bbe17b4e-5367-4d3d-9183-d5d152524966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:40.288294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f157b9c-ae1f-49e1-8431-e7f90d370de0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:40.296542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:40.297198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.297480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.297758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.300660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:40.316456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1048/2104] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:40.319746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe17b4e-5367-4d3d-9183-d5d152524966 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:40.322435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bbe17b4e-5367-4d3d-9183-d5d152524966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:40.335188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe17b4e-5367-4d3d-9183-d5d152524966 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:40.340010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295bd45-25f9-45e6-a84b-3eb913a13e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:40.340893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295bd45-25f9-45e6-a84b-3eb913a13e17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.341179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295bd45-25f9-45e6-a84b-3eb913a13e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.341456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295bd45-25f9-45e6-a84b-3eb913a13e17 admin admin] PATH_INFO: `/v3/projects/fde6f4c7aa2b4cc8ad441470dc722ed9/users/e24f6665d95e48c7b694d19b0dd132e2/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.357905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295bd45-25f9-45e6-a84b-3eb913a13e17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fde6f4c7aa2b4cc8ad441470dc722ed9, user_id=e24f6665d95e48c7b694d19b0dd132e2, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:40.361374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295bd45-25f9-45e6-a84b-3eb913a13e17 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:40.367526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:40.368972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:40.378636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1057/2105] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:40.379458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:40.380870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:40.446169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbeac2-aa22-4c26-8ecc-ddff47298209 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:40.455137 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd689f-64e5-448c-a09c-518bd5ba8c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:40.455817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd689f-64e5-448c-a09c-518bd5ba8c7c service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.456106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd689f-64e5-448c-a09c-518bd5ba8c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.456392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd689f-64e5-448c-a09c-518bd5ba8c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.466472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd689f-64e5-448c-a09c-518bd5ba8c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:40.469188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd689f-64e5-448c-a09c-518bd5ba8c7c service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:40.481288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1058/2106] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:40.531870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1049/2107] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:40 2022] PUT /identity/v3/projects/fde6f4c7aa2b4cc8ad441470dc722ed9/users/e24f6665d95e48c7b694d19b0dd132e2/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:40.532747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010456b2-c8a6-403f-ae9f-a242192d1a4f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.533043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010456b2-c8a6-403f-ae9f-a242192d1a4f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.533327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010456b2-c8a6-403f-ae9f-a242192d1a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.543525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295bd45-25f9-45e6-a84b-3eb913a13e17 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:40.548407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8295bd45-25f9-45e6-a84b-3eb913a13e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:40.560561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-010456b2-c8a6-403f-ae9f-a242192d1a4f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:40.562466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-010456b2-c8a6-403f-ae9f-a242192d1a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:40.631501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:40.638051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1059/2108] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:40.650601 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010456b2-c8a6-403f-ae9f-a242192d1a4f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:40.663798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295bd45-25f9-45e6-a84b-3eb913a13e17 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:40.668663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:40.674883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.674883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.674883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] PATH_INFO: `/v3/users/1438e192e4f640819b0e755049339749` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.674883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1438e192e4f640819b0e755049339749)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:40.674883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:40.712964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010456b2-c8a6-403f-ae9f-a242192d1a4f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:40.716863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ff2a0-da1a-48b0-9879-10eab099cb11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:40.717524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ff2a0-da1a-48b0-9879-10eab099cb11 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.717813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ff2a0-da1a-48b0-9879-10eab099cb11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.718627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ff2a0-da1a-48b0-9879-10eab099cb11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.728653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ff2a0-da1a-48b0-9879-10eab099cb11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:40.730095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ff2a0-da1a-48b0-9879-10eab099cb11 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:40.740858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1060/2109] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:40.756855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:40.884561 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1438e192e4f640819b0e755049339749'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.885229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1438e192e4f640819b0e755049339749'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.897328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1438e192e4f640819b0e755049339749'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.904148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1438e192e4f640819b0e755049339749'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.964366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ff2a0-da1a-48b0-9879-10eab099cb11 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:40.972743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-336ff2a0-da1a-48b0-9879-10eab099cb11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:40.980811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ff2a0-da1a-48b0-9879-10eab099cb11 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:40.986488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:40.987536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:40.987886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:40.988235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] PATH_INFO: `/v3/projects/5e8e9ffc656e4ff992cc950ddd910e89` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:40.989849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8e9ffc656e4ff992cc950ddd910e89)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:40.990941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8c14f363-c22c-431d-8c1a-90b53695322e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1438e192e4f640819b0e755049339749'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:40.992063 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:41.001881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1050/2110] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:40 2022] DELETE /identity/v3/users/1438e192e4f640819b0e755049339749 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:41.004861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e433f09-27db-405d-8c60-18273f9b4c6f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:41.005335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e433f09-27db-405d-8c60-18273f9b4c6f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:41.005616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e433f09-27db-405d-8c60-18273f9b4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:41.026431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9e433f09-27db-405d-8c60-18273f9b4c6f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:41.030058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9e433f09-27db-405d-8c60-18273f9b4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:41.085810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1051/2111] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:41.096138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e433f09-27db-405d-8c60-18273f9b4c6f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:41.097496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9e433f09-27db-405d-8c60-18273f9b4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:41.151459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8e9ffc656e4ff992cc950ddd910e89', 'request_id': 'req-94e0deb9-db89-4fa1-8820-79ad8cda09fa'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:41.160610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e433f09-27db-405d-8c60-18273f9b4c6f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:41.214545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78b346-a3f0-4ea5-91ed-6dbb50485e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:41.215490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78b346-a3f0-4ea5-91ed-6dbb50485e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:41.215670 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78b346-a3f0-4ea5-91ed-6dbb50485e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:41.215930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78b346-a3f0-4ea5-91ed-6dbb50485e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:41.244531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:41.270444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8e9ffc656e4ff992cc950ddd910e89', 'request_id': 'req-94e0deb9-db89-4fa1-8820-79ad8cda09fa'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:41.276714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8e9ffc656e4ff992cc950ddd910e89', 'request_id': 'req-94e0deb9-db89-4fa1-8820-79ad8cda09fa'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:41.289265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] The token cache is being invalidate because project 5e8e9ffc656e4ff992cc950ddd910e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:41.289626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:41.290408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:41.291116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78b346-a3f0-4ea5-91ed-6dbb50485e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:41.292141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1061/2112] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:40 2022] DELETE /identity/v3/projects/5e8e9ffc656e4ff992cc950ddd910e89 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:41.292576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78b346-a3f0-4ea5-91ed-6dbb50485e14 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:41.319094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1052/2113] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:41.395185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:41.794971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:41.797367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:41.813627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0deb9-db89-4fa1-8820-79ad8cda09fa admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:41.818456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:41.820596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:41.820596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:41.820596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] PATH_INFO: `/v3/projects/89102621a80c4891b20d323c45187886` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:41.822108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=89102621a80c4891b20d323c45187886)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:41.824055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:41.862340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:41.955037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89102621a80c4891b20d323c45187886', 'request_id': 'req-f30de605-7ac0-40db-8855-c40c7ca5c25e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.073510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89102621a80c4891b20d323c45187886', 'request_id': 'req-f30de605-7ac0-40db-8855-c40c7ca5c25e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.080053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89102621a80c4891b20d323c45187886', 'request_id': 'req-f30de605-7ac0-40db-8855-c40c7ca5c25e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.093874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] The token cache is being invalidate because project 89102621a80c4891b20d323c45187886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:42.094288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.094933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f30de605-7ac0-40db-8855-c40c7ca5c25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.096471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1062/2114] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:41 2022] DELETE /identity/v3/projects/89102621a80c4891b20d323c45187886 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:42.100603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78b346-a3f0-4ea5-91ed-6dbb50485e14 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:42.102242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2f78b346-a3f0-4ea5-91ed-6dbb50485e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:42.115746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78b346-a3f0-4ea5-91ed-6dbb50485e14 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:42.200897 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:42.202035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:42.202327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:42.203644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] PATH_INFO: `/v3/users/3f27303678c54f8f9e38a1ec0cc7993f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:42.205001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f27303678c54f8f9e38a1ec0cc7993f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:42.208954 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:42.241530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23272e-3d48-4b8b-8b20-fd8f18836466 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:42.241820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23272e-3d48-4b8b-8b20-fd8f18836466 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:42.242105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23272e-3d48-4b8b-8b20-fd8f18836466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:42.273349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-af23272e-3d48-4b8b-8b20-fd8f18836466 None None] MFA Rules not processed for user `e24f6665d95e48c7b694d19b0dd132e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:42.274622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-af23272e-3d48-4b8b-8b20-fd8f18836466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:42.345041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1063/2115] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:42.356018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23272e-3d48-4b8b-8b20-fd8f18836466 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:42.357389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-af23272e-3d48-4b8b-8b20-fd8f18836466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:42.415683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23272e-3d48-4b8b-8b20-fd8f18836466 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:42.419424 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d43f0-9adc-47ca-845c-305cbfa77be7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:42.420163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d43f0-9adc-47ca-845c-305cbfa77be7 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:42.420399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d43f0-9adc-47ca-845c-305cbfa77be7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:42.420677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d43f0-9adc-47ca-845c-305cbfa77be7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:42.429295 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d43f0-9adc-47ca-845c-305cbfa77be7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:42.430732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d43f0-9adc-47ca-845c-305cbfa77be7 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:42.442055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1064/2116] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:42.448540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f27303678c54f8f9e38a1ec0cc7993f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.449213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f27303678c54f8f9e38a1ec0cc7993f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.462346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f27303678c54f8f9e38a1ec0cc7993f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.470010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f27303678c54f8f9e38a1ec0cc7993f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.531037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d931a9e-177b-4a0b-ba40-9ef04b749d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f27303678c54f8f9e38a1ec0cc7993f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:42.538347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1053/2117] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:42 2022] DELETE /identity/v3/users/3f27303678c54f8f9e38a1ec0cc7993f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:42.648615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:42.726098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:42.970131 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d43f0-9adc-47ca-845c-305cbfa77be7 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:42.971703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-de6d43f0-9adc-47ca-845c-305cbfa77be7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:42.986374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d43f0-9adc-47ca-845c-305cbfa77be7 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:43.047957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:43.048994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:43.049281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:43.049564 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] PATH_INFO: `/v3/projects/81fbd6948c804fe38d1aa0506ab302d2` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:43.050833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fbd6948c804fe38d1aa0506ab302d2)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:43.052823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:43.163533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fbd6948c804fe38d1aa0506ab302d2', 'request_id': 'req-71ebe00f-6938-4aa7-a721-addb0b339cae'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:43.270506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fbd6948c804fe38d1aa0506ab302d2', 'request_id': 'req-71ebe00f-6938-4aa7-a721-addb0b339cae'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:43.276857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fbd6948c804fe38d1aa0506ab302d2', 'request_id': 'req-71ebe00f-6938-4aa7-a721-addb0b339cae'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:43.289683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] The token cache is being invalidate because project 81fbd6948c804fe38d1aa0506ab302d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:43.289973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:43.290684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-71ebe00f-6938-4aa7-a721-addb0b339cae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:43.296924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1065/2118] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:42 2022] DELETE /identity/v3/projects/81fbd6948c804fe38d1aa0506ab302d2 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:43.300819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd23b7-d054-46cc-b200-825cceeed082 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:43.301273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd23b7-d054-46cc-b200-825cceeed082 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:43.301380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd23b7-d054-46cc-b200-825cceeed082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:43.326029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0fdd23b7-d054-46cc-b200-825cceeed082 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:43.326029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0fdd23b7-d054-46cc-b200-825cceeed082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:43.383376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1054/2119] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:43.392427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc3220-b815-475d-a203-5144f63ffc0a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:43.392722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc3220-b815-475d-a203-5144f63ffc0a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:43.393003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc3220-b815-475d-a203-5144f63ffc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:43.412604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-58cc3220-b815-475d-a203-5144f63ffc0a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:43.413823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-58cc3220-b815-475d-a203-5144f63ffc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:43.422081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1066/2120] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:43.426633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd23b7-d054-46cc-b200-825cceeed082 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:43.436501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd23b7-d054-46cc-b200-825cceeed082 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:43.441495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce7d2-35d7-4339-9053-4b51cc495dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:43.442160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce7d2-35d7-4339-9053-4b51cc495dab admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:43.442445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce7d2-35d7-4339-9053-4b51cc495dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:43.442726 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce7d2-35d7-4339-9053-4b51cc495dab admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:43.443857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce7d2-35d7-4339-9053-4b51cc495dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:43.444173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce7d2-35d7-4339-9053-4b51cc495dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:43.445780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce7d2-35d7-4339-9053-4b51cc495dab admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:43.458431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1055/2121] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:43.462770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc3220-b815-475d-a203-5144f63ffc0a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:43.472622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc3220-b815-475d-a203-5144f63ffc0a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:43.477439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574423b-f2e9-4b8a-b32b-b2368f2b890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:43.478101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574423b-f2e9-4b8a-b32b-b2368f2b890d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:43.478387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574423b-f2e9-4b8a-b32b-b2368f2b890d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:43.478662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574423b-f2e9-4b8a-b32b-b2368f2b890d admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:43.479417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574423b-f2e9-4b8a-b32b-b2368f2b890d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:43.481346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574423b-f2e9-4b8a-b32b-b2368f2b890d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:43.496617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:43.630636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1067/2122] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:43 2022] POST /identity/v3/projects => generated 407 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:43.634980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce7d2-35d7-4339-9053-4b51cc495dab admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:43.645949 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce7d2-35d7-4339-9053-4b51cc495dab admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:43.701071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e8619-74e7-4580-a051-3eaa554cccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:43.701735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8619-74e7-4580-a051-3eaa554cccf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:43.702021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8619-74e7-4580-a051-3eaa554cccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:43.702301 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e8619-74e7-4580-a051-3eaa554cccf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:43.703697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e8619-74e7-4580-a051-3eaa554cccf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:43.705677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e8619-74e7-4580-a051-3eaa554cccf4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:43.817343 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1056/2123] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:43 2022] POST /identity/v3/users => generated 304 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:43.821274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574423b-f2e9-4b8a-b32b-b2368f2b890d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:43.833128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574423b-f2e9-4b8a-b32b-b2368f2b890d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:43.837829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f9207-ac0b-42ca-9ce5-932eab746d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:43.838496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f9207-ac0b-42ca-9ce5-932eab746d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:43.838785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f9207-ac0b-42ca-9ce5-932eab746d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:43.839097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f9207-ac0b-42ca-9ce5-932eab746d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:43.839824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f9207-ac0b-42ca-9ce5-932eab746d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:43.841582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f9207-ac0b-42ca-9ce5-932eab746d07 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:43.852700 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1068/2124] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:43.856859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e8619-74e7-4580-a051-3eaa554cccf4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:43.867523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e8619-74e7-4580-a051-3eaa554cccf4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:43.872158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a63c7a-7685-48ec-aaa3-8f8db04ebc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:43.872822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a63c7a-7685-48ec-aaa3-8f8db04ebc4c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:43.873103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a63c7a-7685-48ec-aaa3-8f8db04ebc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:43.873379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a63c7a-7685-48ec-aaa3-8f8db04ebc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:43.874977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a63c7a-7685-48ec-aaa3-8f8db04ebc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:43.876883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a63c7a-7685-48ec-aaa3-8f8db04ebc4c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:43.887967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1057/2125] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:43.893336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f9207-ac0b-42ca-9ce5-932eab746d07 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:43.903610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f9207-ac0b-42ca-9ce5-932eab746d07 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:43.908917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96579c-1348-4409-b4fd-56eaf9d9db84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:43.911889 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96579c-1348-4409-b4fd-56eaf9d9db84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:43.911889 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96579c-1348-4409-b4fd-56eaf9d9db84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:43.911889 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96579c-1348-4409-b4fd-56eaf9d9db84 admin admin] PATH_INFO: `/v3/projects/50a120053b014fbd86d591f2793461aa/users/041371bf1d6241db9afd40b2df8eb081/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:43.926480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96579c-1348-4409-b4fd-56eaf9d9db84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50a120053b014fbd86d591f2793461aa, user_id=041371bf1d6241db9afd40b2df8eb081, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:43.929335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96579c-1348-4409-b4fd-56eaf9d9db84 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:44.045343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1069/2126] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:43 2022] PUT /identity/v3/projects/50a120053b014fbd86d591f2793461aa/users/041371bf1d6241db9afd40b2df8eb081/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:44.057439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f638-e071-47f2-89f1-6fcf62f6315f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.057735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f638-e071-47f2-89f1-6fcf62f6315f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.058016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562f638-e071-47f2-89f1-6fcf62f6315f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.085319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c562f638-e071-47f2-89f1-6fcf62f6315f None None] MFA Rules not processed for user `041371bf1d6241db9afd40b2df8eb081`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:44.086578 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c562f638-e071-47f2-89f1-6fcf62f6315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:44.153218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1058/2127] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:44 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:44.157820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96579c-1348-4409-b4fd-56eaf9d9db84 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:44.222303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96579c-1348-4409-b4fd-56eaf9d9db84 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:44.232855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cea9f1-a9d7-49a6-9aac-3378df5372fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:44.234711 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cea9f1-a9d7-49a6-9aac-3378df5372fc admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.235098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cea9f1-a9d7-49a6-9aac-3378df5372fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.235478 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cea9f1-a9d7-49a6-9aac-3378df5372fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.236450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cea9f1-a9d7-49a6-9aac-3378df5372fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:44.238528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cea9f1-a9d7-49a6-9aac-3378df5372fc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:44.275595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c75a-2497-498c-a655-e8494c5e5963 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.275892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c75a-2497-498c-a655-e8494c5e5963 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.276170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4c75a-2497-498c-a655-e8494c5e5963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.298512 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a0b4c75a-2497-498c-a655-e8494c5e5963 None None] MFA Rules not processed for user `e24f6665d95e48c7b694d19b0dd132e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:44.299820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a0b4c75a-2497-498c-a655-e8494c5e5963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:44.338366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1070/2128] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:44 2022] POST /identity/v3/projects => generated 409 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:44.339571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cea9f1-a9d7-49a6-9aac-3378df5372fc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:44.387982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1059/2129] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:44.401917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:44.417609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cea9f1-a9d7-49a6-9aac-3378df5372fc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:44.423625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036743c-288a-4c71-9e22-7fb91d60f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:44.424729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036743c-288a-4c71-9e22-7fb91d60f50b admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.425548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036743c-288a-4c71-9e22-7fb91d60f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.425548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036743c-288a-4c71-9e22-7fb91d60f50b admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.426015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036743c-288a-4c71-9e22-7fb91d60f50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:44.428166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036743c-288a-4c71-9e22-7fb91d60f50b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:44.574292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1071/2130] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:44 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:44.576249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4c75a-2497-498c-a655-e8494c5e5963 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:44.593608 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4c75a-2497-498c-a655-e8494c5e5963 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:44.604985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fb55-a331-442d-be5d-012c7bbc2976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:44.605875 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fb55-a331-442d-be5d-012c7bbc2976 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.606339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fb55-a331-442d-be5d-012c7bbc2976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.606768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770fb55-a331-442d-be5d-012c7bbc2976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.607691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fb55-a331-442d-be5d-012c7bbc2976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:44.610700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770fb55-a331-442d-be5d-012c7bbc2976 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:44.626926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1060/2131] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:44.627029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036743c-288a-4c71-9e22-7fb91d60f50b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:44.636818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036743c-288a-4c71-9e22-7fb91d60f50b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:44.645686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b3063-e721-46bd-9cfa-39eb9d4bdd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:44.646959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b3063-e721-46bd-9cfa-39eb9d4bdd1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.647525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b3063-e721-46bd-9cfa-39eb9d4bdd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.648261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b3063-e721-46bd-9cfa-39eb9d4bdd1a admin admin] PATH_INFO: `/v3/projects/bbe05a4849af4634965388cd23120b62/users/e1ac3de338c746169166e16853270ceb/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.668298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fb55-a331-442d-be5d-012c7bbc2976 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:44.670547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6770fb55-a331-442d-be5d-012c7bbc2976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:44.671989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b3063-e721-46bd-9cfa-39eb9d4bdd1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe05a4849af4634965388cd23120b62, user_id=e1ac3de338c746169166e16853270ceb, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:44.674988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b3063-e721-46bd-9cfa-39eb9d4bdd1a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:44.688931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770fb55-a331-442d-be5d-012c7bbc2976 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:44.694333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:44.695302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.695629 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.696273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] PATH_INFO: `/v3/users/7e4de035baea4894b829a3b6e69efec9` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.697208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4de035baea4894b829a3b6e69efec9)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:44.699173 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:44.738089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1072/2132] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:44 2022] PUT /identity/v3/projects/bbe05a4849af4634965388cd23120b62/users/e1ac3de338c746169166e16853270ceb/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:44.742267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b3063-e721-46bd-9cfa-39eb9d4bdd1a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:44.808278 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b3063-e721-46bd-9cfa-39eb9d4bdd1a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:44.814745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1616cc7-ad14-4e7a-ae38-de898560fd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:44.815773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1616cc7-ad14-4e7a-ae38-de898560fd52 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.816060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1616cc7-ad14-4e7a-ae38-de898560fd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.816466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1616cc7-ad14-4e7a-ae38-de898560fd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.817350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1616cc7-ad14-4e7a-ae38-de898560fd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:44.819071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1616cc7-ad14-4e7a-ae38-de898560fd52 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:44.819538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:44.833036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1073/2133] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:47:44.834154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1616cc7-ad14-4e7a-ae38-de898560fd52 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:44.844115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1616cc7-ad14-4e7a-ae38-de898560fd52 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:44.849464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7393e-0d94-40bf-bb80-b14e3ea346ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:44.850473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7393e-0d94-40bf-bb80-b14e3ea346ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.856200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7393e-0d94-40bf-bb80-b14e3ea346ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.856200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7393e-0d94-40bf-bb80-b14e3ea346ff admin admin] PATH_INFO: `/v3/projects/bbe05a4849af4634965388cd23120b62/users/e1ac3de338c746169166e16853270ceb/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.856200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7393e-0d94-40bf-bb80-b14e3ea346ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbe05a4849af4634965388cd23120b62, user_id=e1ac3de338c746169166e16853270ceb, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:44.856200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7393e-0d94-40bf-bb80-b14e3ea346ff admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:44.879529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1074/2134] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:44 2022] PUT /identity/v3/projects/bbe05a4849af4634965388cd23120b62/users/e1ac3de338c746169166e16853270ceb/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:44.889526 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f4b7c-6f70-48c1-bb98-a22d084f8517 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:44.890615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f4b7c-6f70-48c1-bb98-a22d084f8517 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:44.892117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f4b7c-6f70-48c1-bb98-a22d084f8517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:44.894292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4de035baea4894b829a3b6e69efec9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:44.895024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4de035baea4894b829a3b6e69efec9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:44.909797 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4de035baea4894b829a3b6e69efec9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:44.920969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4d0f4b7c-6f70-48c1-bb98-a22d084f8517 None None] MFA Rules not processed for user `e1ac3de338c746169166e16853270ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:44.922707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4d0f4b7c-6f70-48c1-bb98-a22d084f8517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:44.930517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4de035baea4894b829a3b6e69efec9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:44.969222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:44.996793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4de035baea4894b829a3b6e69efec9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:44.998902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1075/2135] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:45.003899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1061/2136] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:44 2022] DELETE /identity/v3/users/7e4de035baea4894b829a3b6e69efec9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:45.008326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4ef6-3700-441c-b4b6-53d69cda0be5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:45.008718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4ef6-3700-441c-b4b6-53d69cda0be5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:45.009065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4ef6-3700-441c-b4b6-53d69cda0be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:45.011116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:45.012486 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:45.028306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1e6a4ef6-3700-441c-b4b6-53d69cda0be5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:45.029500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1e6a4ef6-3700-441c-b4b6-53d69cda0be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:45.071086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592b64-4cd6-4e6f-8d2f-06d05654c02b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:45.074853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746c9aa-d516-4036-a279-2d4970d00138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:45.075698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c9aa-d516-4036-a279-2d4970d00138 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:45.076059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c9aa-d516-4036-a279-2d4970d00138 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:45.076334 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746c9aa-d516-4036-a279-2d4970d00138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:45.095461 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1076/2137] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:45.102380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4ef6-3700-441c-b4b6-53d69cda0be5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:45.104968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1e6a4ef6-3700-441c-b4b6-53d69cda0be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:45.155193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746c9aa-d516-4036-a279-2d4970d00138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:45.157208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746c9aa-d516-4036-a279-2d4970d00138 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:45.170751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1062/2138] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:45.189562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4ef6-3700-441c-b4b6-53d69cda0be5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:45.194391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b7f90-d3bb-4ed1-b444-6df88a0a07c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:45.195165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b7f90-d3bb-4ed1-b444-6df88a0a07c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:45.200908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b7f90-d3bb-4ed1-b444-6df88a0a07c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:45.200908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b7f90-d3bb-4ed1-b444-6df88a0a07c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:45.209436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b7f90-d3bb-4ed1-b444-6df88a0a07c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:45.211012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b7f90-d3bb-4ed1-b444-6df88a0a07c5 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:45.227025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1077/2139] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:47:45.276952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:45.563367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746c9aa-d516-4036-a279-2d4970d00138 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:45.571570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746c9aa-d516-4036-a279-2d4970d00138 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:45.585674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c5c3-900a-40bd-a87a-7d9648aea858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:45.586550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c5c3-900a-40bd-a87a-7d9648aea858 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:45.587412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c5c3-900a-40bd-a87a-7d9648aea858 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:45.587719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890c5c3-900a-40bd-a87a-7d9648aea858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:45.593953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8890c5c3-900a-40bd-a87a-7d9648aea858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:45.656149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890c5c3-900a-40bd-a87a-7d9648aea858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:45.657625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890c5c3-900a-40bd-a87a-7d9648aea858 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:45.666591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1063/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:45.707807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b7f90-d3bb-4ed1-b444-6df88a0a07c5 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:45.709962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-001b7f90-d3bb-4ed1-b444-6df88a0a07c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:45.717311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:45.741761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b7f90-d3bb-4ed1-b444-6df88a0a07c5 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:45.747342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:45.748731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:45.749089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:45.749992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] PATH_INFO: `/v3/projects/aa1ef1e9737046dba161cf95d4b9c349` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:45.751541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1ef1e9737046dba161cf95d4b9c349)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:45.756036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:45.906981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1ef1e9737046dba161cf95d4b9c349', 'request_id': 'req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.021941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1ef1e9737046dba161cf95d4b9c349', 'request_id': 'req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.022332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:46.028132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1ef1e9737046dba161cf95d4b9c349', 'request_id': 'req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.039780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] The token cache is being invalidate because project aa1ef1e9737046dba161cf95d4b9c349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:46.040071 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.040716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.042261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1078/2141] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:45 2022] DELETE /identity/v3/projects/aa1ef1e9737046dba161cf95d4b9c349 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:46.046906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c5c3-900a-40bd-a87a-7d9648aea858 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:46.057726 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890c5c3-900a-40bd-a87a-7d9648aea858 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:46.114911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:46.115999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:46.116162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:46.116460 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] PATH_INFO: `/v3/users/ff936518f8414ca2bdaaaf32968962c6` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:46.117745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff936518f8414ca2bdaaaf32968962c6)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:46.119699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:46.347371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff936518f8414ca2bdaaaf32968962c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.348024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff936518f8414ca2bdaaaf32968962c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.360164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff936518f8414ca2bdaaaf32968962c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.367015 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff936518f8414ca2bdaaaf32968962c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.439599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-05c8021f-166b-4ae2-8bf1-8f038dd352bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff936518f8414ca2bdaaaf32968962c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:46.453057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1064/2142] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:46 2022] DELETE /identity/v3/users/ff936518f8414ca2bdaaaf32968962c6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:46.471836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:46.889528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:46.891805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:46.904884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c4df-63ef-4bd3-bb91-2f68f0674546 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:46.911065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:46.969997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:46.971106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:46.971454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:46.971684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] PATH_INFO: `/v3/projects/b03e0be217ea44289910748324db8638` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:46.972939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03e0be217ea44289910748324db8638)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:46.974994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:47.105131 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03e0be217ea44289910748324db8638', 'request_id': 'req-9b536e20-843c-4007-aec5-398014555d1d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:47.167723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:47.190170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03e0be217ea44289910748324db8638', 'request_id': 'req-9b536e20-843c-4007-aec5-398014555d1d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:47.195865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03e0be217ea44289910748324db8638', 'request_id': 'req-9b536e20-843c-4007-aec5-398014555d1d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:47.207251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] The token cache is being invalidate because project b03e0be217ea44289910748324db8638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:47.212280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:47.212280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9b536e20-843c-4007-aec5-398014555d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:47.212280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1079/2143] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:46 2022] DELETE /identity/v3/projects/b03e0be217ea44289910748324db8638 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:47.214830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef29b3-6e5c-4df0-9136-9cb18358473e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:47.215149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef29b3-6e5c-4df0-9136-9cb18358473e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:47.215437 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef29b3-6e5c-4df0-9136-9cb18358473e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:47.243128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bbef29b3-6e5c-4df0-9136-9cb18358473e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:47.243128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bbef29b3-6e5c-4df0-9136-9cb18358473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:47.297497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1065/2144] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:47.305428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320334d6-bbe3-467f-a477-9dde2731c7a4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:47.305724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320334d6-bbe3-467f-a477-9dde2731c7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:47.306206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320334d6-bbe3-467f-a477-9dde2731c7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:47.325883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-320334d6-bbe3-467f-a477-9dde2731c7a4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:47.327244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-320334d6-bbe3-467f-a477-9dde2731c7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:47.335576 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1080/2145] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:47:47.339602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef29b3-6e5c-4df0-9136-9cb18358473e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:47.350216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef29b3-6e5c-4df0-9136-9cb18358473e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:47.355517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75a001-13ff-4770-b127-70ed469c871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:47.356178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75a001-13ff-4770-b127-70ed469c871c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:47.356461 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75a001-13ff-4770-b127-70ed469c871c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:47.356767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75a001-13ff-4770-b127-70ed469c871c admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:47.357498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75a001-13ff-4770-b127-70ed469c871c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:47.357812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75a001-13ff-4770-b127-70ed469c871c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:47.360603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75a001-13ff-4770-b127-70ed469c871c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:47.373492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1066/2146] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:47:47.378481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320334d6-bbe3-467f-a477-9dde2731c7a4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:47.387796 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320334d6-bbe3-467f-a477-9dde2731c7a4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:47.393112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2a35-4025-4497-ad2e-7de5a5c75c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:47.393790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2a35-4025-4497-ad2e-7de5a5c75c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:47.394075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2a35-4025-4497-ad2e-7de5a5c75c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:47.394380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c2a35-4025-4497-ad2e-7de5a5c75c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:47.395101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c2a35-4025-4497-ad2e-7de5a5c75c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:47.396994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c2a35-4025-4497-ad2e-7de5a5c75c96 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:47.514592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1081/2147] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:47 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:47:47.517693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75a001-13ff-4770-b127-70ed469c871c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:47.522935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:47.527812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75a001-13ff-4770-b127-70ed469c871c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:47.583041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:47.595734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb3169-dd3e-4532-8d6e-e74cb9e63963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:47.596410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb3169-dd3e-4532-8d6e-e74cb9e63963 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:47.596696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb3169-dd3e-4532-8d6e-e74cb9e63963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:47.596975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb3169-dd3e-4532-8d6e-e74cb9e63963 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:47.597674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb3169-dd3e-4532-8d6e-e74cb9e63963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:47.599662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb3169-dd3e-4532-8d6e-e74cb9e63963 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:47.677340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1067/2148] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:47 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:47.681429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2a35-4025-4497-ad2e-7de5a5c75c96 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:47.693148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c2a35-4025-4497-ad2e-7de5a5c75c96 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:47.697913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1a0f-5b56-44a4-85d1-08229b667bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:47.698753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1a0f-5b56-44a4-85d1-08229b667bea admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:47.699097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1a0f-5b56-44a4-85d1-08229b667bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:47.699377 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba1a0f-5b56-44a4-85d1-08229b667bea admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:47.700230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba1a0f-5b56-44a4-85d1-08229b667bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:47.701845 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba1a0f-5b56-44a4-85d1-08229b667bea admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:47.713068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1082/2149] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:47.720222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb3169-dd3e-4532-8d6e-e74cb9e63963 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:47.730474 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb3169-dd3e-4532-8d6e-e74cb9e63963 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:47.736328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01823659-0992-440c-87ed-8c4c4339e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:47.737156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823659-0992-440c-87ed-8c4c4339e28d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:47.737518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823659-0992-440c-87ed-8c4c4339e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:47.737901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01823659-0992-440c-87ed-8c4c4339e28d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:47.738720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01823659-0992-440c-87ed-8c4c4339e28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:47.740655 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01823659-0992-440c-87ed-8c4c4339e28d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:47.754511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1068/2150] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:47.758769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1a0f-5b56-44a4-85d1-08229b667bea admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:47.770115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba1a0f-5b56-44a4-85d1-08229b667bea admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:47.774738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c526-72ab-46e6-9558-8f1958bc64da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:47.776406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c526-72ab-46e6-9558-8f1958bc64da admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:47.776406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c526-72ab-46e6-9558-8f1958bc64da admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:47.776406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916c526-72ab-46e6-9558-8f1958bc64da admin admin] PATH_INFO: `/v3/projects/e47bc94f6af94fb6994d808439aaee75/users/6f863286cdc04cf2863a11f4adcbac12/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:47.792161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c526-72ab-46e6-9558-8f1958bc64da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47bc94f6af94fb6994d808439aaee75, user_id=6f863286cdc04cf2863a11f4adcbac12, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:47.794830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916c526-72ab-46e6-9558-8f1958bc64da admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:47.883356 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1083/2151] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:47 2022] PUT /identity/v3/projects/e47bc94f6af94fb6994d808439aaee75/users/6f863286cdc04cf2863a11f4adcbac12/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:47.888658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604acbb-d116-4753-a6aa-1ab1a2000fc5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:47.889815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604acbb-d116-4753-a6aa-1ab1a2000fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:47.889815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604acbb-d116-4753-a6aa-1ab1a2000fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:47.909691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7604acbb-d116-4753-a6aa-1ab1a2000fc5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:47.914179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7604acbb-d116-4753-a6aa-1ab1a2000fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:47.973325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1069/2152] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:47.991578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c526-72ab-46e6-9558-8f1958bc64da admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:47.994716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6916c526-72ab-46e6-9558-8f1958bc64da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:48.057834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916c526-72ab-46e6-9558-8f1958bc64da admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:48.061930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6f7c9-729f-4a11-b318-c3623171f55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:48.062910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6f7c9-729f-4a11-b318-c3623171f55e service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:48.063198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6f7c9-729f-4a11-b318-c3623171f55e service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:48.063589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6f7c9-729f-4a11-b318-c3623171f55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:48.073194 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6f7c9-729f-4a11-b318-c3623171f55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:48.074755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6f7c9-729f-4a11-b318-c3623171f55e service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:48.085610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1084/2153] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:49.586077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cde24-3b28-4542-bf08-b38a4c65f422 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:49.586601 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cde24-3b28-4542-bf08-b38a4c65f422 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:49.586682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cde24-3b28-4542-bf08-b38a4c65f422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:49.624184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b08cde24-3b28-4542-bf08-b38a4c65f422 None None] MFA Rules not processed for user `6f863286cdc04cf2863a11f4adcbac12`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:49.625900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b08cde24-3b28-4542-bf08-b38a4c65f422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:49.750899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1070/2154] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:49.753215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6f7c9-729f-4a11-b318-c3623171f55e service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:49.762934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6f7c9-729f-4a11-b318-c3623171f55e service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:49.781348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632194c3-6369-4f13-af9c-c7f49349dbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:49.782001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632194c3-6369-4f13-af9c-c7f49349dbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:49.782288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632194c3-6369-4f13-af9c-c7f49349dbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:49.782744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632194c3-6369-4f13-af9c-c7f49349dbc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:49.783484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632194c3-6369-4f13-af9c-c7f49349dbc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:49.785386 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632194c3-6369-4f13-af9c-c7f49349dbc8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:49.904260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1085/2155] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:49 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:49.905708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cde24-3b28-4542-bf08-b38a4c65f422 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:49.917101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cde24-3b28-4542-bf08-b38a4c65f422 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:49.990425 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:49.997110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83de0fb-37d6-4180-baa3-0cf5f0060967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:49.997874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83de0fb-37d6-4180-baa3-0cf5f0060967 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:50.000445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83de0fb-37d6-4180-baa3-0cf5f0060967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:50.000942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83de0fb-37d6-4180-baa3-0cf5f0060967 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:50.002327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83de0fb-37d6-4180-baa3-0cf5f0060967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:50.008404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83de0fb-37d6-4180-baa3-0cf5f0060967 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:50.115228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1071/2156] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:49 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:50.116662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632194c3-6369-4f13-af9c-c7f49349dbc8 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:50.128476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632194c3-6369-4f13-af9c-c7f49349dbc8 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:50.133173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654d4c4-4d43-474c-8c56-0fe901bf6b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:50.133897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654d4c4-4d43-474c-8c56-0fe901bf6b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:50.134163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654d4c4-4d43-474c-8c56-0fe901bf6b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:50.134730 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654d4c4-4d43-474c-8c56-0fe901bf6b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:50.135206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654d4c4-4d43-474c-8c56-0fe901bf6b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:50.136857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654d4c4-4d43-474c-8c56-0fe901bf6b29 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:50.148866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1086/2157] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:50.153271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83de0fb-37d6-4180-baa3-0cf5f0060967 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:50.168433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83de0fb-37d6-4180-baa3-0cf5f0060967 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:50.177565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376c539-51e4-4f60-95cf-4554bec8efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:50.178537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376c539-51e4-4f60-95cf-4554bec8efb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:50.178835 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376c539-51e4-4f60-95cf-4554bec8efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:50.179144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376c539-51e4-4f60-95cf-4554bec8efb7 admin admin] PATH_INFO: `/v3/projects/5be5e22ee81b4c1f8e7943af8970af22/users/a069459412a94615963012631b9ab862/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:50.197890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376c539-51e4-4f60-95cf-4554bec8efb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be5e22ee81b4c1f8e7943af8970af22, user_id=a069459412a94615963012631b9ab862, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:50.202115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376c539-51e4-4f60-95cf-4554bec8efb7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:50.277437 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1072/2158] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:50 2022] PUT /identity/v3/projects/5be5e22ee81b4c1f8e7943af8970af22/users/a069459412a94615963012631b9ab862/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:47:50.281475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654d4c4-4d43-474c-8c56-0fe901bf6b29 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:50.291822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654d4c4-4d43-474c-8c56-0fe901bf6b29 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:50.367304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56606cc-b463-44af-810a-880c3c4160f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:50.367909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56606cc-b463-44af-810a-880c3c4160f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:50.368216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56606cc-b463-44af-810a-880c3c4160f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:50.368494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56606cc-b463-44af-810a-880c3c4160f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:50.369327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56606cc-b463-44af-810a-880c3c4160f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:50.371078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56606cc-b463-44af-810a-880c3c4160f2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:50.381515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1087/2159] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:50.385651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376c539-51e4-4f60-95cf-4554bec8efb7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:50.396751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376c539-51e4-4f60-95cf-4554bec8efb7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:50.401759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1434771-07ed-48bb-9b7c-240da8ff229f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:50.402639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434771-07ed-48bb-9b7c-240da8ff229f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:50.402964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434771-07ed-48bb-9b7c-240da8ff229f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:50.403254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1434771-07ed-48bb-9b7c-240da8ff229f admin admin] PATH_INFO: `/v3/projects/5be5e22ee81b4c1f8e7943af8970af22/users/a069459412a94615963012631b9ab862/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:50.405321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1434771-07ed-48bb-9b7c-240da8ff229f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be5e22ee81b4c1f8e7943af8970af22, user_id=a069459412a94615963012631b9ab862, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:50.408618 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1434771-07ed-48bb-9b7c-240da8ff229f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:50.418938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1073/2160] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:50 2022] PUT /identity/v3/projects/5be5e22ee81b4c1f8e7943af8970af22/users/a069459412a94615963012631b9ab862/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:52.463710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e122d5-b4a3-4f10-8e85-4608a010eae0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:52.464129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e122d5-b4a3-4f10-8e85-4608a010eae0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:52.464358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e122d5-b4a3-4f10-8e85-4608a010eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:52.466323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d2ca2-bb08-45b0-8aa1-a9a9fa940b95 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:52.467139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d2ca2-bb08-45b0-8aa1-a9a9fa940b95 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:52.467824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d2ca2-bb08-45b0-8aa1-a9a9fa940b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:52.500561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-29e122d5-b4a3-4f10-8e85-4608a010eae0 None None] MFA Rules not processed for user `a069459412a94615963012631b9ab862`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:52.500561 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-29e122d5-b4a3-4f10-8e85-4608a010eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:52.500831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1a7d2ca2-bb08-45b0-8aa1-a9a9fa940b95 None None] MFA Rules not processed for user `2cdef290abf8487ab370969a5e5b76c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:52.501753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1a7d2ca2-bb08-45b0-8aa1-a9a9fa940b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:52.506374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:52.585956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1074/2161] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:52.602409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1088/2162] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:52.614005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3af2-bb70-47cb-bc34-98553c9a0bcd None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:52.614298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3af2-bb70-47cb-bc34-98553c9a0bcd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:52.614579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee3af2-bb70-47cb-bc34-98553c9a0bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:52.632795 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-24ee3af2-bb70-47cb-bc34-98553c9a0bcd None None] MFA Rules not processed for user `6f863286cdc04cf2863a11f4adcbac12`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:52.633989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-24ee3af2-bb70-47cb-bc34-98553c9a0bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:52.692757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1075/2163] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:52.704170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e122d5-b4a3-4f10-8e85-4608a010eae0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:52.705622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-29e122d5-b4a3-4f10-8e85-4608a010eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:52.782292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e122d5-b4a3-4f10-8e85-4608a010eae0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:52.787961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d808bdd-083d-418d-845b-6450b286cd41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:52.788616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d808bdd-083d-418d-845b-6450b286cd41 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:52.788904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d808bdd-083d-418d-845b-6450b286cd41 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:52.789182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d808bdd-083d-418d-845b-6450b286cd41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:52.798499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d808bdd-083d-418d-845b-6450b286cd41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:52.800136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d808bdd-083d-418d-845b-6450b286cd41 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:52.809613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1089/2164] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:52.939517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3af2-bb70-47cb-bc34-98553c9a0bcd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:52.941001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-24ee3af2-bb70-47cb-bc34-98553c9a0bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:53.020246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee3af2-bb70-47cb-bc34-98553c9a0bcd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:53.024960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:53.025971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:53.026358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:53.026730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] PATH_INFO: `/v3/users/041371bf1d6241db9afd40b2df8eb081` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:53.028844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=041371bf1d6241db9afd40b2df8eb081)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:53.030118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:53.032844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:53.223086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041371bf1d6241db9afd40b2df8eb081'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:53.223907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041371bf1d6241db9afd40b2df8eb081'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:53.245837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041371bf1d6241db9afd40b2df8eb081'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:53.252664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041371bf1d6241db9afd40b2df8eb081'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:53.322230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041371bf1d6241db9afd40b2df8eb081'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:53.341171 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1076/2165] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:52 2022] DELETE /identity/v3/users/041371bf1d6241db9afd40b2df8eb081 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:53.346379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334e0a8-bd7f-4959-ad17-2c5f60094368 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:53.346682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334e0a8-bd7f-4959-ad17-2c5f60094368 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:53.347113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334e0a8-bd7f-4959-ad17-2c5f60094368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:53.367125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e334e0a8-bd7f-4959-ad17-2c5f60094368 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:53.368339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e334e0a8-bd7f-4959-ad17-2c5f60094368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:53.443912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1090/2166] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:53.456250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:53.457950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:53.540356 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5b97a-0d74-434f-a7c3-ec76ae2712d0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:53.544480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04d89e-fd56-4229-96d5-507c8d3990d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:53.545094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d89e-fd56-4229-96d5-507c8d3990d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:53.545384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d89e-fd56-4229-96d5-507c8d3990d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:53.545660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d89e-fd56-4229-96d5-507c8d3990d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:53.555771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d89e-fd56-4229-96d5-507c8d3990d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:53.557167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d89e-fd56-4229-96d5-507c8d3990d4 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:53.567383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1077/2167] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:47:54.021275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334e0a8-bd7f-4959-ad17-2c5f60094368 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:54.022860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e334e0a8-bd7f-4959-ad17-2c5f60094368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:54.035337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334e0a8-bd7f-4959-ad17-2c5f60094368 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:54.041749 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:54.042604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:54.044761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:54.044761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] PATH_INFO: `/v3/projects/50a120053b014fbd86d591f2793461aa` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:54.044761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=50a120053b014fbd86d591f2793461aa)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:54.047988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:54.074324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:54.173471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50a120053b014fbd86d591f2793461aa', 'request_id': 'req-746558e4-4fbe-4fe5-b18c-59e943bda6fc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.231065 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50a120053b014fbd86d591f2793461aa', 'request_id': 'req-746558e4-4fbe-4fe5-b18c-59e943bda6fc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.237869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50a120053b014fbd86d591f2793461aa', 'request_id': 'req-746558e4-4fbe-4fe5-b18c-59e943bda6fc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.249921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] The token cache is being invalidate because project 50a120053b014fbd86d591f2793461aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:54.250432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.251397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.252983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1091/2168] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:54 2022] DELETE /identity/v3/projects/50a120053b014fbd86d591f2793461aa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:54.257114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04d89e-fd56-4229-96d5-507c8d3990d4 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:54.268730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04d89e-fd56-4229-96d5-507c8d3990d4 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:54.331707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:54.332589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:54.332874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:54.333152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] PATH_INFO: `/v3/users/e1ac3de338c746169166e16853270ceb` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:54.334400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ac3de338c746169166e16853270ceb)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:54.336371 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:54.359058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:54.597874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ac3de338c746169166e16853270ceb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.598895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ac3de338c746169166e16853270ceb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.612718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ac3de338c746169166e16853270ceb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.619497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ac3de338c746169166e16853270ceb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.752323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7145f36e-fab9-4636-9c96-1a462382b6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ac3de338c746169166e16853270ceb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:54.761444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1078/2169] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:47:54 2022] DELETE /identity/v3/users/e1ac3de338c746169166e16853270ceb => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:55.183936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:55.185691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:55.201908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746558e4-4fbe-4fe5-b18c-59e943bda6fc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:55.262882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:55.263662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:55.263946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:55.264474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] PATH_INFO: `/v3/projects/bbe05a4849af4634965388cd23120b62` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:55.265919 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbe05a4849af4634965388cd23120b62)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:55.268027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:55.380437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbe05a4849af4634965388cd23120b62', 'request_id': 'req-1490db91-6a72-44b7-adae-8bdb187d238f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:55.450752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbe05a4849af4634965388cd23120b62', 'request_id': 'req-1490db91-6a72-44b7-adae-8bdb187d238f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:55.457293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbe05a4849af4634965388cd23120b62', 'request_id': 'req-1490db91-6a72-44b7-adae-8bdb187d238f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:55.469786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] The token cache is being invalidate because project bbe05a4849af4634965388cd23120b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:47:55.470076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:55.471585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1490db91-6a72-44b7-adae-8bdb187d238f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:47:55.473591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1092/2170] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:47:55 2022] DELETE /identity/v3/projects/bbe05a4849af4634965388cd23120b62 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:55.478361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59be26-773f-4f54-96bc-b494fb36e952 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:55.478652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59be26-773f-4f54-96bc-b494fb36e952 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:55.478969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59be26-773f-4f54-96bc-b494fb36e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:55.497816 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ea59be26-773f-4f54-96bc-b494fb36e952 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:55.499110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ea59be26-773f-4f54-96bc-b494fb36e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:55.584410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1079/2171] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:55.598374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09994a4-b611-4fde-b268-944353ea640f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:55.598699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09994a4-b611-4fde-b268-944353ea640f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:55.599013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09994a4-b611-4fde-b268-944353ea640f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:55.630558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d09994a4-b611-4fde-b268-944353ea640f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:55.632022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d09994a4-b611-4fde-b268-944353ea640f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:55.641169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1093/2172] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:55.646308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59be26-773f-4f54-96bc-b494fb36e952 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:55.656860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59be26-773f-4f54-96bc-b494fb36e952 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:55.661946 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f76446-0b0a-49ad-818d-8fc524b090bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:55.662665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76446-0b0a-49ad-818d-8fc524b090bc admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:55.662989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76446-0b0a-49ad-818d-8fc524b090bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:55.663274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76446-0b0a-49ad-818d-8fc524b090bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:55.664013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f76446-0b0a-49ad-818d-8fc524b090bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:47:55.664347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f76446-0b0a-49ad-818d-8fc524b090bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:55.665955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f76446-0b0a-49ad-818d-8fc524b090bc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:55.690116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1080/2173] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:47:55.693386 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09994a4-b611-4fde-b268-944353ea640f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:55.707467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09994a4-b611-4fde-b268-944353ea640f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:55.712899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75306df-2fec-460a-acaa-681907d4dc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:55.713599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75306df-2fec-460a-acaa-681907d4dc8d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:55.713890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75306df-2fec-460a-acaa-681907d4dc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:55.714172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75306df-2fec-460a-acaa-681907d4dc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:55.714930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75306df-2fec-460a-acaa-681907d4dc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:55.716858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75306df-2fec-460a-acaa-681907d4dc8d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:55.802249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1094/2174] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:47:55 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:55.806470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f76446-0b0a-49ad-818d-8fc524b090bc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:55.818577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f76446-0b0a-49ad-818d-8fc524b090bc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:55.881513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72fc08-949c-4669-9338-82f0e8027af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:55.882205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72fc08-949c-4669-9338-82f0e8027af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:55.882492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72fc08-949c-4669-9338-82f0e8027af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:55.882771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72fc08-949c-4669-9338-82f0e8027af3 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:55.883530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72fc08-949c-4669-9338-82f0e8027af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:55.885506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72fc08-949c-4669-9338-82f0e8027af3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:56.008260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1081/2175] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:47:55 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:47:56.012456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75306df-2fec-460a-acaa-681907d4dc8d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:56.023920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75306df-2fec-460a-acaa-681907d4dc8d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:56.029990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873f04b-bf48-4b7b-89f1-f81ac6e3b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:56.031219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873f04b-bf48-4b7b-89f1-f81ac6e3b20e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:56.031219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873f04b-bf48-4b7b-89f1-f81ac6e3b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:56.031423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873f04b-bf48-4b7b-89f1-f81ac6e3b20e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:56.032099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873f04b-bf48-4b7b-89f1-f81ac6e3b20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:56.033829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873f04b-bf48-4b7b-89f1-f81ac6e3b20e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:56.039423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:56.050159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1095/2176] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:56.051354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72fc08-949c-4669-9338-82f0e8027af3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:56.061654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72fc08-949c-4669-9338-82f0e8027af3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:56.067254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b0ba9-f2da-4c1a-ab0b-f14c3c17365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:56.067915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b0ba9-f2da-4c1a-ab0b-f14c3c17365d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:56.068464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b0ba9-f2da-4c1a-ab0b-f14c3c17365d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:56.068464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b0ba9-f2da-4c1a-ab0b-f14c3c17365d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:56.069291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b0ba9-f2da-4c1a-ab0b-f14c3c17365d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:56.070925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b0ba9-f2da-4c1a-ab0b-f14c3c17365d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:56.081252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1082/2177] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:47:56.085621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873f04b-bf48-4b7b-89f1-f81ac6e3b20e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:56.096185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873f04b-bf48-4b7b-89f1-f81ac6e3b20e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:56.101081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542fd4-4333-401f-aeaa-13e486592a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:56.101978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542fd4-4333-401f-aeaa-13e486592a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:56.102292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542fd4-4333-401f-aeaa-13e486592a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:56.102569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d542fd4-4333-401f-aeaa-13e486592a9e admin admin] PATH_INFO: `/v3/projects/b7fa36d78b354705aaf98b7e12d7a5e0/users/34e740f1efd34ead8e60ad7cb8427434/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:56.118018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542fd4-4333-401f-aeaa-13e486592a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fa36d78b354705aaf98b7e12d7a5e0, user_id=34e740f1efd34ead8e60ad7cb8427434, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:56.120742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d542fd4-4333-401f-aeaa-13e486592a9e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:56.201987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1096/2178] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:47:56 2022] PUT /identity/v3/projects/b7fa36d78b354705aaf98b7e12d7a5e0/users/34e740f1efd34ead8e60ad7cb8427434/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:47:56.212243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ffcf-5f78-4ae5-b039-da16436c2fe4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:56.212558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ffcf-5f78-4ae5-b039-da16436c2fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:56.212833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5ffcf-5f78-4ae5-b039-da16436c2fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:56.225739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:47:56.240146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-67e5ffcf-5f78-4ae5-b039-da16436c2fe4 None None] MFA Rules not processed for user `34e740f1efd34ead8e60ad7cb8427434`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:47:56.241340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-67e5ffcf-5f78-4ae5-b039-da16436c2fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:56.306575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1083/2179] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:47:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:47:56.318152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542fd4-4333-401f-aeaa-13e486592a9e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:47:56.319884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3d542fd4-4333-401f-aeaa-13e486592a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:47:56.388244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d542fd4-4333-401f-aeaa-13e486592a9e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:47:56.393008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3831178-b5ac-4f6e-be42-cda770f4b5ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:47:56.393656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831178-b5ac-4f6e-be42-cda770f4b5ae service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:47:56.394376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831178-b5ac-4f6e-be42-cda770f4b5ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:47:56.394376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3831178-b5ac-4f6e-be42-cda770f4b5ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:47:56.407301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3831178-b5ac-4f6e-be42-cda770f4b5ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:47:56.408755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3831178-b5ac-4f6e-be42-cda770f4b5ae service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:47:56.418448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1097/2180] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:47:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:04.556661 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ffcf-5f78-4ae5-b039-da16436c2fe4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:04.647651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5ffcf-5f78-4ae5-b039-da16436c2fe4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:04.652467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:04.653464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:04.653754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:04.654037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] PATH_INFO: `/v3/users/34e740f1efd34ead8e60ad7cb8427434` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:04.655318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e740f1efd34ead8e60ad7cb8427434)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:04.657287 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:04.862380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e740f1efd34ead8e60ad7cb8427434'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:04.863084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e740f1efd34ead8e60ad7cb8427434'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:04.883112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e740f1efd34ead8e60ad7cb8427434'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:04.892040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e740f1efd34ead8e60ad7cb8427434'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:04.973532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e740f1efd34ead8e60ad7cb8427434'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:04.980190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1084/2181] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:48:04 2022] DELETE /identity/v3/users/34e740f1efd34ead8e60ad7cb8427434 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:04.985307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f4bbd-9d2c-45c1-9d48-2b54705f9c50 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:04.985819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f4bbd-9d2c-45c1-9d48-2b54705f9c50 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:04.985987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f4bbd-9d2c-45c1-9d48-2b54705f9c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:05.004980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fd2f4bbd-9d2c-45c1-9d48-2b54705f9c50 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:05.006651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fd2f4bbd-9d2c-45c1-9d48-2b54705f9c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:05.117672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1098/2182] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:05.128745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:05.130330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:05.149754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:05.198734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d85ed5-8241-4d14-897b-e6889a8e7289 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:05.206002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe12e26-0a17-464e-9f4f-6060d1c2716e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:05.206722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12e26-0a17-464e-9f4f-6060d1c2716e service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:05.207054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12e26-0a17-464e-9f4f-6060d1c2716e service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:05.207339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe12e26-0a17-464e-9f4f-6060d1c2716e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:05.217843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe12e26-0a17-464e-9f4f-6060d1c2716e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:05.220233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe12e26-0a17-464e-9f4f-6060d1c2716e service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:05.232274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1085/2183] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:05.939984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f4bbd-9d2c-45c1-9d48-2b54705f9c50 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:05.939984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fd2f4bbd-9d2c-45c1-9d48-2b54705f9c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:05.955417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f4bbd-9d2c-45c1-9d48-2b54705f9c50 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:05.960728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:05.961930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:05.962169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:05.962450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] PATH_INFO: `/v3/projects/b7fa36d78b354705aaf98b7e12d7a5e0` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:05.967833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fa36d78b354705aaf98b7e12d7a5e0)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:05.970780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:06.131947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fa36d78b354705aaf98b7e12d7a5e0', 'request_id': 'req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:06.237410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fa36d78b354705aaf98b7e12d7a5e0', 'request_id': 'req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:06.243328 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fa36d78b354705aaf98b7e12d7a5e0', 'request_id': 'req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:06.255088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] The token cache is being invalidate because project b7fa36d78b354705aaf98b7e12d7a5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:48:06.255376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:06.256013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6441884a-d8a9-4a10-bbb1-a5d8f6f60258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:06.257566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1099/2184] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:48:05 2022] DELETE /identity/v3/projects/b7fa36d78b354705aaf98b7e12d7a5e0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:06.262354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fbacc-5f10-45c3-9da7-b3e2cb85b317 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:06.262809 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fbacc-5f10-45c3-9da7-b3e2cb85b317 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:06.262945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fbacc-5f10-45c3-9da7-b3e2cb85b317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:06.285470 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1b2fbacc-5f10-45c3-9da7-b3e2cb85b317 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:06.286687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1b2fbacc-5f10-45c3-9da7-b3e2cb85b317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:06.350751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1086/2185] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:06.358397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0fb7-7bf2-4f32-9ddb-e6706b34cf74 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:06.358873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0fb7-7bf2-4f32-9ddb-e6706b34cf74 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:06.359101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd0fb7-7bf2-4f32-9ddb-e6706b34cf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:06.365658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:06.378834 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-aecd0fb7-7bf2-4f32-9ddb-e6706b34cf74 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:06.380533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-aecd0fb7-7bf2-4f32-9ddb-e6706b34cf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:06.389266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1100/2186] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:06.399996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fbacc-5f10-45c3-9da7-b3e2cb85b317 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:06.410088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fbacc-5f10-45c3-9da7-b3e2cb85b317 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:06.414827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae6807-a023-4171-90e1-a8f5b9b0d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:06.415615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae6807-a023-4171-90e1-a8f5b9b0d449 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:06.415905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae6807-a023-4171-90e1-a8f5b9b0d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:06.416179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae6807-a023-4171-90e1-a8f5b9b0d449 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:06.417485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae6807-a023-4171-90e1-a8f5b9b0d449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:48:06.417485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae6807-a023-4171-90e1-a8f5b9b0d449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:06.419115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae6807-a023-4171-90e1-a8f5b9b0d449 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:06.433093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1087/2187] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:48:06.439904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd0fb7-7bf2-4f32-9ddb-e6706b34cf74 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:06.449903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd0fb7-7bf2-4f32-9ddb-e6706b34cf74 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:06.459477 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53fd45-e8fb-4e34-a29d-ce86016a0c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:06.460513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53fd45-e8fb-4e34-a29d-ce86016a0c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:06.460966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53fd45-e8fb-4e34-a29d-ce86016a0c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:06.461742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53fd45-e8fb-4e34-a29d-ce86016a0c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:06.462791 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53fd45-e8fb-4e34-a29d-ce86016a0c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:06.464897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53fd45-e8fb-4e34-a29d-ce86016a0c29 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:06.550309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1101/2188] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:48:06 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:48:06.556214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae6807-a023-4171-90e1-a8f5b9b0d449 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:06.589938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae6807-a023-4171-90e1-a8f5b9b0d449 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:06.684092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7d932-25a4-46c8-8e5a-8b7d5a76ec12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:06.684856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7d932-25a4-46c8-8e5a-8b7d5a76ec12 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:06.685146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7d932-25a4-46c8-8e5a-8b7d5a76ec12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:06.685427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7d932-25a4-46c8-8e5a-8b7d5a76ec12 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:06.686126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7d932-25a4-46c8-8e5a-8b7d5a76ec12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:06.688266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7d932-25a4-46c8-8e5a-8b7d5a76ec12 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:06.794393 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1088/2189] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:48:06 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:48:06.799309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53fd45-e8fb-4e34-a29d-ce86016a0c29 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:06.814254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53fd45-e8fb-4e34-a29d-ce86016a0c29 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:06.818876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c92be-b73c-4b7b-8ac8-e39c54df4038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:06.819569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c92be-b73c-4b7b-8ac8-e39c54df4038 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:06.819853 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c92be-b73c-4b7b-8ac8-e39c54df4038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:06.820129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c92be-b73c-4b7b-8ac8-e39c54df4038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:06.820863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c92be-b73c-4b7b-8ac8-e39c54df4038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:06.822588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c92be-b73c-4b7b-8ac8-e39c54df4038 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:06.834697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1102/2190] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:48:06.841575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7d932-25a4-46c8-8e5a-8b7d5a76ec12 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:06.868017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7d932-25a4-46c8-8e5a-8b7d5a76ec12 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:06.874806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58b0878-b584-46d8-af4d-d1ed3de25653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:06.874806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b0878-b584-46d8-af4d-d1ed3de25653 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:06.874806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b0878-b584-46d8-af4d-d1ed3de25653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:06.874806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58b0878-b584-46d8-af4d-d1ed3de25653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:06.876151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b0878-b584-46d8-af4d-d1ed3de25653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:06.877879 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58b0878-b584-46d8-af4d-d1ed3de25653 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:06.895038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1089/2191] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:48:06.897928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c92be-b73c-4b7b-8ac8-e39c54df4038 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:06.921974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c92be-b73c-4b7b-8ac8-e39c54df4038 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:06.929445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f8d1-1a82-4756-8ba7-9955daa776fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:06.934009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f8d1-1a82-4756-8ba7-9955daa776fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:06.934009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f8d1-1a82-4756-8ba7-9955daa776fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:06.934009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723f8d1-1a82-4756-8ba7-9955daa776fe admin admin] PATH_INFO: `/v3/projects/7921725a84204225a0ed47945b1203bb/users/9fba6f7a63f7446ba40c9421a671f77e/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:06.957756 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f8d1-1a82-4756-8ba7-9955daa776fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7921725a84204225a0ed47945b1203bb, user_id=9fba6f7a63f7446ba40c9421a671f77e, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:06.960554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723f8d1-1a82-4756-8ba7-9955daa776fe admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:07.052004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1103/2192] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:48:06 2022] PUT /identity/v3/projects/7921725a84204225a0ed47945b1203bb/users/9fba6f7a63f7446ba40c9421a671f77e/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:07.055491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb6ebb-03d4-4004-913e-390e42e16677 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:07.055803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb6ebb-03d4-4004-913e-390e42e16677 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:07.056081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb6ebb-03d4-4004-913e-390e42e16677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:07.091454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0ddb6ebb-03d4-4004-913e-390e42e16677 None None] MFA Rules not processed for user `9fba6f7a63f7446ba40c9421a671f77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:07.093036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0ddb6ebb-03d4-4004-913e-390e42e16677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:07.113551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:07.184009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1090/2193] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:07.192881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f8d1-1a82-4756-8ba7-9955daa776fe admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:07.195736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1723f8d1-1a82-4756-8ba7-9955daa776fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:07.258318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723f8d1-1a82-4756-8ba7-9955daa776fe admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:07.262115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1bb7a-5f60-477a-9efc-dbf5f11d66c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:07.262776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1bb7a-5f60-477a-9efc-dbf5f11d66c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:07.263095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1bb7a-5f60-477a-9efc-dbf5f11d66c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:07.263375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1bb7a-5f60-477a-9efc-dbf5f11d66c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:07.272829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1bb7a-5f60-477a-9efc-dbf5f11d66c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:07.276109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1bb7a-5f60-477a-9efc-dbf5f11d66c8 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:07.282934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1104/2194] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:11.283714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736cca-cfb3-4156-8859-3c6492fdc3be None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:11.284212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736cca-cfb3-4156-8859-3c6492fdc3be None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:11.284312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736cca-cfb3-4156-8859-3c6492fdc3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:11.320644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-04736cca-cfb3-4156-8859-3c6492fdc3be None None] MFA Rules not processed for user `cbb22c3df9e9452db19974f52d3ebb17`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:11.322073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-04736cca-cfb3-4156-8859-3c6492fdc3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:11.405690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1091/2195] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:13.150185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1bb7a-5f60-477a-9efc-dbf5f11d66c8 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:13.183058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1bb7a-5f60-477a-9efc-dbf5f11d66c8 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:13.189994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:13.191156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:13.191676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:13.192187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:13.195189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:13.305680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:13.309013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:13.310600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:13.325282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1105/2196] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:21.397369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=46 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:23.550750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:32.202593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083abb6-3b37-4bc7-b55d-9543eca6e85b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:32.203104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083abb6-3b37-4bc7-b55d-9543eca6e85b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:32.203222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083abb6-3b37-4bc7-b55d-9543eca6e85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:32.291548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d083abb6-3b37-4bc7-b55d-9543eca6e85b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:32.292752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d083abb6-3b37-4bc7-b55d-9543eca6e85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:32.383690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1092/2197] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:32.410038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:32.411502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:32.502232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b974e0d-0749-4787-821a-8361d61fcaff service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:32.507774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757075-3c67-4b03-8f53-a5071c8a6737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:32.508420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757075-3c67-4b03-8f53-a5071c8a6737 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:32.508701 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757075-3c67-4b03-8f53-a5071c8a6737 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:32.509002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757075-3c67-4b03-8f53-a5071c8a6737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:32.517774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61757075-3c67-4b03-8f53-a5071c8a6737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:32.519492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61757075-3c67-4b03-8f53-a5071c8a6737 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:32.531222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1106/2198] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:35.633198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08297a44-c447-45fc-89f9-26f1c8237e8d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:35.633731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08297a44-c447-45fc-89f9-26f1c8237e8d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:35.633847 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08297a44-c447-45fc-89f9-26f1c8237e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:35.663330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-08297a44-c447-45fc-89f9-26f1c8237e8d None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:35.664760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-08297a44-c447-45fc-89f9-26f1c8237e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:35.724063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1093/2199] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:48:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:35.767374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757075-3c67-4b03-8f53-a5071c8a6737 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:35.769407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-61757075-3c67-4b03-8f53-a5071c8a6737 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:35.842858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61757075-3c67-4b03-8f53-a5071c8a6737 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:35.848514 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcaf57-6b83-4cab-90a1-5fcd788de186 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:35.849159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcaf57-6b83-4cab-90a1-5fcd788de186 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:35.849444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcaf57-6b83-4cab-90a1-5fcd788de186 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:35.849728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcaf57-6b83-4cab-90a1-5fcd788de186 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:35.858131 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcaf57-6b83-4cab-90a1-5fcd788de186 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:35.859748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcaf57-6b83-4cab-90a1-5fcd788de186 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:35.868074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1107/2200] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:48:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:48:37.698430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ecc4f-9f8d-42e2-8b46-fc939f40f06f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:37.699451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ecc4f-9f8d-42e2-8b46-fc939f40f06f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:37.699977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ecc4f-9f8d-42e2-8b46-fc939f40f06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:37.738610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1c1ecc4f-9f8d-42e2-8b46-fc939f40f06f None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:37.739963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1c1ecc4f-9f8d-42e2-8b46-fc939f40f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:37.748973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1094/2201] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:37.787330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcaf57-6b83-4cab-90a1-5fcd788de186 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:37.875219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcaf57-6b83-4cab-90a1-5fcd788de186 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:37.886525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de5a4f-52fc-40c0-b0c8-388647e65d20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:37.887348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de5a4f-52fc-40c0-b0c8-388647e65d20 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:37.887942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de5a4f-52fc-40c0-b0c8-388647e65d20 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:37.889618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de5a4f-52fc-40c0-b0c8-388647e65d20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:37.911984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de5a4f-52fc-40c0-b0c8-388647e65d20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:37.913670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de5a4f-52fc-40c0-b0c8-388647e65d20 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:37.930523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1108/2202] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:43.053945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ecc4f-9f8d-42e2-8b46-fc939f40f06f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:43.055542 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1c1ecc4f-9f8d-42e2-8b46-fc939f40f06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:43.070302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ecc4f-9f8d-42e2-8b46-fc939f40f06f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:43.079273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:43.080870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:43.081321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:43.081607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] PATH_INFO: `/v3/users/6f863286cdc04cf2863a11f4adcbac12` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:43.083004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f863286cdc04cf2863a11f4adcbac12)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:43.085994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:43.201020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:43.287485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f863286cdc04cf2863a11f4adcbac12'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:43.288185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f863286cdc04cf2863a11f4adcbac12'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:43.302712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f863286cdc04cf2863a11f4adcbac12'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:43.308335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1bf72-e1fa-4ede-85b6-260503bfeaef None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:43.310497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1bf72-e1fa-4ede-85b6-260503bfeaef None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:43.310872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1bf72-e1fa-4ede-85b6-260503bfeaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:43.336871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f863286cdc04cf2863a11f4adcbac12'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:43.338053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5bf1bf72-e1fa-4ede-85b6-260503bfeaef None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:43.339552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5bf1bf72-e1fa-4ede-85b6-260503bfeaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:43.350348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1109/2203] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:43.375210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1bf72-e1fa-4ede-85b6-260503bfeaef None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:43.377004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5bf1bf72-e1fa-4ede-85b6-260503bfeaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:43.405092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f863286cdc04cf2863a11f4adcbac12'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:43.417763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1bf72-e1fa-4ede-85b6-260503bfeaef None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:43.422242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1095/2204] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:48:43 2022] DELETE /identity/v3/users/6f863286cdc04cf2863a11f4adcbac12 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:43.438290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:43.526448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321f277-1f1e-4b3e-9bd7-4b305bb78754 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:43.527189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f277-1f1e-4b3e-9bd7-4b305bb78754 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:43.527481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f277-1f1e-4b3e-9bd7-4b305bb78754 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:43.527764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321f277-1f1e-4b3e-9bd7-4b305bb78754 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:43.639126 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321f277-1f1e-4b3e-9bd7-4b305bb78754 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:43.642739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321f277-1f1e-4b3e-9bd7-4b305bb78754 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:43.655879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1110/2205] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:48:43.732226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:43.734134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:43.788617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed8fdf-c6d0-4ae0-a0e0-d004aa0ed0ed admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:43.806375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:43.808869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:43.809265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:43.809669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] PATH_INFO: `/v3/projects/e47bc94f6af94fb6994d808439aaee75` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:43.813175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47bc94f6af94fb6994d808439aaee75)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:43.815220 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:43.968090 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47bc94f6af94fb6994d808439aaee75', 'request_id': 'req-95fe5d1c-e625-442d-851c-4a91d989b3e6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:43.974873 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47bc94f6af94fb6994d808439aaee75', 'request_id': 'req-95fe5d1c-e625-442d-851c-4a91d989b3e6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:44.030353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47bc94f6af94fb6994d808439aaee75', 'request_id': 'req-95fe5d1c-e625-442d-851c-4a91d989b3e6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:44.044270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] The token cache is being invalidate because project e47bc94f6af94fb6994d808439aaee75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:48:44.044564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:44.045231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:44.046993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1096/2206] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:48:43 2022] DELETE /identity/v3/projects/e47bc94f6af94fb6994d808439aaee75 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:44.053773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321f277-1f1e-4b3e-9bd7-4b305bb78754 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:44.075971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321f277-1f1e-4b3e-9bd7-4b305bb78754 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:44.153630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:44.154642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:44.155060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:44.155437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] PATH_INFO: `/v3/users/a069459412a94615963012631b9ab862` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:44.157799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a069459412a94615963012631b9ab862)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:44.160791 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:44.368822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a069459412a94615963012631b9ab862'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:44.374147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:44.385357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a069459412a94615963012631b9ab862'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:44.482172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a069459412a94615963012631b9ab862'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:44.482942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a069459412a94615963012631b9ab862'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:44.492197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a56c6d06-9e19-4788-8900-5a85e495f2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a069459412a94615963012631b9ab862'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:44.502740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1111/2207] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:48:44 2022] DELETE /identity/v3/users/a069459412a94615963012631b9ab862 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:44.771106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:44.772638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:44.820983 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe5d1c-e625-442d-851c-4a91d989b3e6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:44.895358 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:44.896227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:44.896507 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:44.896784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] PATH_INFO: `/v3/projects/5be5e22ee81b4c1f8e7943af8970af22` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:44.898040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be5e22ee81b4c1f8e7943af8970af22)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:44.901933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:45.012604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:45.031231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be5e22ee81b4c1f8e7943af8970af22', 'request_id': 'req-f43a5308-c0d0-48ce-b345-f180d392bb1a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:45.039336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be5e22ee81b4c1f8e7943af8970af22', 'request_id': 'req-f43a5308-c0d0-48ce-b345-f180d392bb1a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:45.108100 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be5e22ee81b4c1f8e7943af8970af22', 'request_id': 'req-f43a5308-c0d0-48ce-b345-f180d392bb1a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:45.124884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] The token cache is being invalidate because project 5be5e22ee81b4c1f8e7943af8970af22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:48:45.125273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:45.126096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f43a5308-c0d0-48ce-b345-f180d392bb1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:45.131638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1097/2208] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:48:44 2022] DELETE /identity/v3/projects/5be5e22ee81b4c1f8e7943af8970af22 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:45.133417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22f88-4e91-400c-bd69-06131f14aeb4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:45.133737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22f88-4e91-400c-bd69-06131f14aeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:45.134022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd22f88-4e91-400c-bd69-06131f14aeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:45.152970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7dd22f88-4e91-400c-bd69-06131f14aeb4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:45.154258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7dd22f88-4e91-400c-bd69-06131f14aeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:45.231623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1112/2209] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:45.240457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e9bd-20e8-4591-bbff-465a4cfdae69 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:45.240744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e9bd-20e8-4591-bbff-465a4cfdae69 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:45.241023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9213e9bd-20e8-4591-bbff-465a4cfdae69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:45.261454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9213e9bd-20e8-4591-bbff-465a4cfdae69 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:45.262700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9213e9bd-20e8-4591-bbff-465a4cfdae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:45.272517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1098/2210] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:48:45.276831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22f88-4e91-400c-bd69-06131f14aeb4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:45.296061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd22f88-4e91-400c-bd69-06131f14aeb4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:45.304934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163512-9057-49ca-903a-3ceba2111f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:45.304934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163512-9057-49ca-903a-3ceba2111f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:45.304934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163512-9057-49ca-903a-3ceba2111f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:45.304934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163512-9057-49ca-903a-3ceba2111f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:45.305430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163512-9057-49ca-903a-3ceba2111f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:48:45.306637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163512-9057-49ca-903a-3ceba2111f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:45.308228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163512-9057-49ca-903a-3ceba2111f6f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:45.332949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1113/2211] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:48:45.341544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e9bd-20e8-4591-bbff-465a4cfdae69 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:45.350370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9213e9bd-20e8-4591-bbff-465a4cfdae69 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:45.355617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c71e-8351-4831-ab97-baaf672962a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:45.356311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c71e-8351-4831-ab97-baaf672962a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:45.356597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c71e-8351-4831-ab97-baaf672962a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:45.356877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0c71e-8351-4831-ab97-baaf672962a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:45.357781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0c71e-8351-4831-ab97-baaf672962a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:45.359970 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0c71e-8351-4831-ab97-baaf672962a4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:45.467120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1099/2212] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:48:45 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:48:45.472805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163512-9057-49ca-903a-3ceba2111f6f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:45.484624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163512-9057-49ca-903a-3ceba2111f6f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:45.550127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e6ab7-9a24-4fce-9d8d-8cd40df2051e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:45.550838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6ab7-9a24-4fce-9d8d-8cd40df2051e admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:45.551148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6ab7-9a24-4fce-9d8d-8cd40df2051e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:45.551429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6ab7-9a24-4fce-9d8d-8cd40df2051e admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:45.552200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e6ab7-9a24-4fce-9d8d-8cd40df2051e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:45.554123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e6ab7-9a24-4fce-9d8d-8cd40df2051e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:46.075759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1114/2213] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:48:45 2022] POST /identity/v3/users => generated 285 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:48:46.078900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c71e-8351-4831-ab97-baaf672962a4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:46.090250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0c71e-8351-4831-ab97-baaf672962a4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:46.094870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52414b-6dd9-49d0-a26d-908f953e086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:46.095947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52414b-6dd9-49d0-a26d-908f953e086d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:46.096242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52414b-6dd9-49d0-a26d-908f953e086d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:46.096706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52414b-6dd9-49d0-a26d-908f953e086d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:46.097458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52414b-6dd9-49d0-a26d-908f953e086d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:46.099106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52414b-6dd9-49d0-a26d-908f953e086d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:46.115212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1100/2214] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:48:46.117493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e6ab7-9a24-4fce-9d8d-8cd40df2051e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:46.128889 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e6ab7-9a24-4fce-9d8d-8cd40df2051e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:46.134113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393cec3-904d-47e1-b91a-ca6234cc4a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:46.134788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393cec3-904d-47e1-b91a-ca6234cc4a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:46.135121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393cec3-904d-47e1-b91a-ca6234cc4a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:46.135404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393cec3-904d-47e1-b91a-ca6234cc4a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:46.136142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393cec3-904d-47e1-b91a-ca6234cc4a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:46.137775 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393cec3-904d-47e1-b91a-ca6234cc4a36 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:46.153179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1115/2215] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:48:46.153993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52414b-6dd9-49d0-a26d-908f953e086d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:46.167814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52414b-6dd9-49d0-a26d-908f953e086d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:46.172596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d5513-26c8-421e-9a12-a9fa8290e66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:46.173487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d5513-26c8-421e-9a12-a9fa8290e66b admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:46.173770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d5513-26c8-421e-9a12-a9fa8290e66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:46.174047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d5513-26c8-421e-9a12-a9fa8290e66b admin admin] PATH_INFO: `/v3/projects/b9b47761431c408480f2be11fd613a61/users/51e583787db9460f976194a1e498d415/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:46.192730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d5513-26c8-421e-9a12-a9fa8290e66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b47761431c408480f2be11fd613a61, user_id=51e583787db9460f976194a1e498d415, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:46.195508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8d5513-26c8-421e-9a12-a9fa8290e66b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:46.277612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1101/2216] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:48:46 2022] PUT /identity/v3/projects/b9b47761431c408480f2be11fd613a61/users/51e583787db9460f976194a1e498d415/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:48:46.282940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d486f-8e2a-4685-8bc7-191973b74771 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:46.283205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d486f-8e2a-4685-8bc7-191973b74771 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:46.283489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d486f-8e2a-4685-8bc7-191973b74771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:46.304218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a49d486f-8e2a-4685-8bc7-191973b74771 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:46.305569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a49d486f-8e2a-4685-8bc7-191973b74771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:46.345020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:46.378423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1116/2217] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:46.388200 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d5513-26c8-421e-9a12-a9fa8290e66b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:46.391114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1a8d5513-26c8-421e-9a12-a9fa8290e66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:46.488660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d5513-26c8-421e-9a12-a9fa8290e66b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:46.494333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4609f7-6ed6-4009-8e8c-fe686293ea66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:46.495107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4609f7-6ed6-4009-8e8c-fe686293ea66 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:46.495492 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4609f7-6ed6-4009-8e8c-fe686293ea66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:46.495723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4609f7-6ed6-4009-8e8c-fe686293ea66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:46.509188 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4609f7-6ed6-4009-8e8c-fe686293ea66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:46.510650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4609f7-6ed6-4009-8e8c-fe686293ea66 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:46.521613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1102/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:48.061158 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd90c6-2aeb-4989-a6e9-71eda04a1147 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:48.061745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd90c6-2aeb-4989-a6e9-71eda04a1147 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:48.061745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd90c6-2aeb-4989-a6e9-71eda04a1147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:48.091976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-56cd90c6-2aeb-4989-a6e9-71eda04a1147 None None] MFA Rules not processed for user `51e583787db9460f976194a1e498d415`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:48.093326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-56cd90c6-2aeb-4989-a6e9-71eda04a1147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:48.175669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1117/2219] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:48.189314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4609f7-6ed6-4009-8e8c-fe686293ea66 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:48.191519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-de4609f7-6ed6-4009-8e8c-fe686293ea66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:48.232366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:48.274204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4609f7-6ed6-4009-8e8c-fe686293ea66 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:48.277898 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d64f2d-b13b-4417-b320-dc2e7a4d0d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:48.278539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d64f2d-b13b-4417-b320-dc2e7a4d0d0e service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:48.278822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d64f2d-b13b-4417-b320-dc2e7a4d0d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:48.279129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d64f2d-b13b-4417-b320-dc2e7a4d0d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:48.288730 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d64f2d-b13b-4417-b320-dc2e7a4d0d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:48.290159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d64f2d-b13b-4417-b320-dc2e7a4d0d0e service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:48.303546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1103/2220] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:51.012347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac157b3-2dbd-4c9b-95c8-4b5f5e2a5693 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:51.012831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac157b3-2dbd-4c9b-95c8-4b5f5e2a5693 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:51.012961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac157b3-2dbd-4c9b-95c8-4b5f5e2a5693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:51.031831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9ac157b3-2dbd-4c9b-95c8-4b5f5e2a5693 None None] MFA Rules not processed for user `51e583787db9460f976194a1e498d415`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:51.033037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9ac157b3-2dbd-4c9b-95c8-4b5f5e2a5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:51.040479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1118/2221] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:54.392880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ac650-e880-4f11-83a5-c3c755adeae5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:54.393391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ac650-e880-4f11-83a5-c3c755adeae5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:54.393511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ac650-e880-4f11-83a5-c3c755adeae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:54.412805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-102ac650-e880-4f11-83a5-c3c755adeae5 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:54.413999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-102ac650-e880-4f11-83a5-c3c755adeae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:54.422097 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1104/2222] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:54.451170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac157b3-2dbd-4c9b-95c8-4b5f5e2a5693 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:54.452613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9ac157b3-2dbd-4c9b-95c8-4b5f5e2a5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:54.528755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac157b3-2dbd-4c9b-95c8-4b5f5e2a5693 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:54.534394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002d1bc1-2026-4b5f-8bf4-0dc2cb24b9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:54.535205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1bc1-2026-4b5f-8bf4-0dc2cb24b9b3 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:54.535408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1bc1-2026-4b5f-8bf4-0dc2cb24b9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:54.536244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1bc1-2026-4b5f-8bf4-0dc2cb24b9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:54.545148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d1bc1-2026-4b5f-8bf4-0dc2cb24b9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:54.546822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002d1bc1-2026-4b5f-8bf4-0dc2cb24b9b3 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:54.556839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1119/2223] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:55.109791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ac650-e880-4f11-83a5-c3c755adeae5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:55.111222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-102ac650-e880-4f11-83a5-c3c755adeae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:55.124049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ac650-e880-4f11-83a5-c3c755adeae5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:55.129185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:55.130044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:55.130328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:55.130607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] PATH_INFO: `/v3/users/9fba6f7a63f7446ba40c9421a671f77e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:55.131885 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fba6f7a63f7446ba40c9421a671f77e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:55.133758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:55.306218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fba6f7a63f7446ba40c9421a671f77e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:55.306979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fba6f7a63f7446ba40c9421a671f77e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:55.320017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fba6f7a63f7446ba40c9421a671f77e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:55.326798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fba6f7a63f7446ba40c9421a671f77e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:55.386634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fba6f7a63f7446ba40c9421a671f77e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:55.388690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1105/2224] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:48:55 2022] DELETE /identity/v3/users/9fba6f7a63f7446ba40c9421a671f77e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:55.393658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcca4d3-ab72-47b0-b670-ce4e91954f77 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:55.393975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcca4d3-ab72-47b0-b670-ce4e91954f77 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:55.394267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcca4d3-ab72-47b0-b670-ce4e91954f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:55.411578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-efcca4d3-ab72-47b0-b670-ce4e91954f77 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:55.412776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-efcca4d3-ab72-47b0-b670-ce4e91954f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:55.453551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:55.470210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1120/2225] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:48:55.480718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:55.482150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:55.541898 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8b83-7a05-42c8-a2fe-78e67d43f09d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:55.545550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33354231-5316-4a4d-8f0c-d005d24c38d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:55.546193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354231-5316-4a4d-8f0c-d005d24c38d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:55.546479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354231-5316-4a4d-8f0c-d005d24c38d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:55.546758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33354231-5316-4a4d-8f0c-d005d24c38d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:55.556352 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33354231-5316-4a4d-8f0c-d005d24c38d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:55.557785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33354231-5316-4a4d-8f0c-d005d24c38d3 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:55.567584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1106/2226] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:48:56.000522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcca4d3-ab72-47b0-b670-ce4e91954f77 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:56.002003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-efcca4d3-ab72-47b0-b670-ce4e91954f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:56.014570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcca4d3-ab72-47b0-b670-ce4e91954f77 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:56.020596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:56.021550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:56.021909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:56.022256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] PATH_INFO: `/v3/projects/7921725a84204225a0ed47945b1203bb` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:56.023995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7921725a84204225a0ed47945b1203bb)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:56.035974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:56.166338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7921725a84204225a0ed47945b1203bb', 'request_id': 'req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:56.279464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7921725a84204225a0ed47945b1203bb', 'request_id': 'req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:56.289078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7921725a84204225a0ed47945b1203bb', 'request_id': 'req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:56.301368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] The token cache is being invalidate because project 7921725a84204225a0ed47945b1203bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:48:56.301723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:56.302816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e2bf00cd-76e1-4e55-b8ae-563e64c7c831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:48:56.307369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1121/2227] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:48:55 2022] DELETE /identity/v3/projects/7921725a84204225a0ed47945b1203bb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:56.309154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d318a-38d2-49c7-a541-03f3f75c6a7c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:56.309445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d318a-38d2-49c7-a541-03f3f75c6a7c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:56.309726 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d318a-38d2-49c7-a541-03f3f75c6a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:56.328272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c25d318a-38d2-49c7-a541-03f3f75c6a7c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:56.329471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c25d318a-38d2-49c7-a541-03f3f75c6a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:56.350993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:48:56.409715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1107/2228] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:56.428712 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc249-53eb-4675-a2fa-311fffe0dcbb None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:56.429089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc249-53eb-4675-a2fa-311fffe0dcbb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:56.429480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc249-53eb-4675-a2fa-311fffe0dcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:56.452303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-591cc249-53eb-4675-a2fa-311fffe0dcbb None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:56.453686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-591cc249-53eb-4675-a2fa-311fffe0dcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:56.463479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1122/2229] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:56.468093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d318a-38d2-49c7-a541-03f3f75c6a7c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:56.478254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d318a-38d2-49c7-a541-03f3f75c6a7c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:56.483021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9349711-f35c-48a9-bc8c-b2a43677f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:56.483863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9349711-f35c-48a9-bc8c-b2a43677f389 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:56.485679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9349711-f35c-48a9-bc8c-b2a43677f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:56.485679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9349711-f35c-48a9-bc8c-b2a43677f389 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:56.485679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9349711-f35c-48a9-bc8c-b2a43677f389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:48:56.485679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9349711-f35c-48a9-bc8c-b2a43677f389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:56.487053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9349711-f35c-48a9-bc8c-b2a43677f389 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:56.500119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1108/2230] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:48:56.510036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cc249-53eb-4675-a2fa-311fffe0dcbb None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:56.522429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591cc249-53eb-4675-a2fa-311fffe0dcbb None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:56.527202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab532afe-ae94-4ac4-b7dc-97e84222079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:56.527869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab532afe-ae94-4ac4-b7dc-97e84222079a admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:56.528157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab532afe-ae94-4ac4-b7dc-97e84222079a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:56.528435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab532afe-ae94-4ac4-b7dc-97e84222079a admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:56.529138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab532afe-ae94-4ac4-b7dc-97e84222079a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:56.531130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab532afe-ae94-4ac4-b7dc-97e84222079a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:56.646645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1123/2231] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:48:56 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:48:56.651038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9349711-f35c-48a9-bc8c-b2a43677f389 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:56.661609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9349711-f35c-48a9-bc8c-b2a43677f389 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:56.717680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0c951-a685-4cdc-a358-44bb702cfb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:56.718342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0c951-a685-4cdc-a358-44bb702cfb4f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:56.718624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0c951-a685-4cdc-a358-44bb702cfb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:56.718935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce0c951-a685-4cdc-a358-44bb702cfb4f admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:56.719616 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0c951-a685-4cdc-a358-44bb702cfb4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:56.721529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce0c951-a685-4cdc-a358-44bb702cfb4f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:56.817098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1109/2232] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:48:56 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:48:56.821232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab532afe-ae94-4ac4-b7dc-97e84222079a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:56.831993 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab532afe-ae94-4ac4-b7dc-97e84222079a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:56.836795 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3c525-6bb4-4ff0-8b95-800c9b94261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:56.837451 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3c525-6bb4-4ff0-8b95-800c9b94261a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:56.837735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3c525-6bb4-4ff0-8b95-800c9b94261a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:56.838009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3c525-6bb4-4ff0-8b95-800c9b94261a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:56.838737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3c525-6bb4-4ff0-8b95-800c9b94261a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:56.840402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3c525-6bb4-4ff0-8b95-800c9b94261a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:56.851051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1124/2233] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:48:56.854829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0c951-a685-4cdc-a358-44bb702cfb4f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:56.865483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce0c951-a685-4cdc-a358-44bb702cfb4f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:56.870270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f593ee-61af-4a54-a624-40556c3fddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:56.870978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f593ee-61af-4a54-a624-40556c3fddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:56.871262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f593ee-61af-4a54-a624-40556c3fddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:56.871540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f593ee-61af-4a54-a624-40556c3fddf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:56.872402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f593ee-61af-4a54-a624-40556c3fddf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:56.874004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f593ee-61af-4a54-a624-40556c3fddf7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:56.884847 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1110/2234] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:48:56.888758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3c525-6bb4-4ff0-8b95-800c9b94261a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:56.898663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3c525-6bb4-4ff0-8b95-800c9b94261a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:56.903536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56173677-74fe-4e36-90f6-a5372a493247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:56.904405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56173677-74fe-4e36-90f6-a5372a493247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:56.904687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56173677-74fe-4e36-90f6-a5372a493247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:56.904967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56173677-74fe-4e36-90f6-a5372a493247 admin admin] PATH_INFO: `/v3/projects/24597948c00f4c2fa40b4e36675e17b4/users/7e9fb58dc6a3488a9af277bb7940e13d/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:56.919473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56173677-74fe-4e36-90f6-a5372a493247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24597948c00f4c2fa40b4e36675e17b4, user_id=7e9fb58dc6a3488a9af277bb7940e13d, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:56.922116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56173677-74fe-4e36-90f6-a5372a493247 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:56.995776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1125/2235] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:48:56 2022] PUT /identity/v3/projects/24597948c00f4c2fa40b4e36675e17b4/users/7e9fb58dc6a3488a9af277bb7940e13d/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:48:57.006868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342487ec-29ef-4551-9daf-a0ca67d1f6e8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:57.007180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342487ec-29ef-4551-9daf-a0ca67d1f6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:57.007491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342487ec-29ef-4551-9daf-a0ca67d1f6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:57.034170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-342487ec-29ef-4551-9daf-a0ca67d1f6e8 None None] MFA Rules not processed for user `7e9fb58dc6a3488a9af277bb7940e13d`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:48:57.036072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-342487ec-29ef-4551-9daf-a0ca67d1f6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:57.101221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1111/2236] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:48:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:48:57.111621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56173677-74fe-4e36-90f6-a5372a493247 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:48:57.113917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-56173677-74fe-4e36-90f6-a5372a493247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:48:57.171439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56173677-74fe-4e36-90f6-a5372a493247 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:48:57.175985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2679a52-7f07-4412-bdea-75c58974db65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:48:57.176961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2679a52-7f07-4412-bdea-75c58974db65 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:48:57.176961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2679a52-7f07-4412-bdea-75c58974db65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:48:57.177164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2679a52-7f07-4412-bdea-75c58974db65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:48:57.185906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2679a52-7f07-4412-bdea-75c58974db65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:48:57.187642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2679a52-7f07-4412-bdea-75c58974db65 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:48:57.197045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1126/2237] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:48:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:49:00.289663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125f03-b1a8-4c3f-afee-637ae4c1c9ea None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:00.290154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125f03-b1a8-4c3f-afee-637ae4c1c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:00.290233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1125f03-b1a8-4c3f-afee-637ae4c1c9ea None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:00.291703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1112/2238] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:49:00.297667 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7f6e4-54f7-4a4b-9b3a-5fb9610ec9aa None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:00.298238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7f6e4-54f7-4a4b-9b3a-5fb9610ec9aa None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:00.298740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7f6e4-54f7-4a4b-9b3a-5fb9610ec9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:00.324854 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:00.351261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-46b7f6e4-54f7-4a4b-9b3a-5fb9610ec9aa None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:00.354505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-46b7f6e4-54f7-4a4b-9b3a-5fb9610ec9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:00.429617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1127/2239] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:49:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:00.441591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1125f03-b1a8-4c3f-afee-637ae4c1c9ea None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:00.443473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a1125f03-b1a8-4c3f-afee-637ae4c1c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:00.485951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:00.528776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1125f03-b1a8-4c3f-afee-637ae4c1c9ea None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:00.533229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045a986-25f4-42ae-a8b9-bf20725ae4b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0a8a5a1bc174acd9b13477c7d4b4a07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:00.533880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045a986-25f4-42ae-a8b9-bf20725ae4b5 service glance] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:00.534163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045a986-25f4-42ae-a8b9-bf20725ae4b5 service glance] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:00.534662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045a986-25f4-42ae-a8b9-bf20725ae4b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:00.546319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045a986-25f4-42ae-a8b9-bf20725ae4b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:00.547793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045a986-25f4-42ae-a8b9-bf20725ae4b5 service glance] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:00.558672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1113/2240] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:49:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:49:00.851713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fb65d-6f7f-49e9-b354-62ce36c71b34 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:00.852011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fb65d-6f7f-49e9-b354-62ce36c71b34 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:00.852296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fb65d-6f7f-49e9-b354-62ce36c71b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:00.872140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-775fb65d-6f7f-49e9-b354-62ce36c71b34 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:00.873339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-775fb65d-6f7f-49e9-b354-62ce36c71b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:00.889474 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569efa1a-df05-4c74-bfe6-a3325b271f5d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:00.889687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569efa1a-df05-4c74-bfe6-a3325b271f5d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:00.889971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569efa1a-df05-4c74-bfe6-a3325b271f5d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:00.891664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1114/2241] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:49:00.897138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9a78c-047b-4ecb-83c2-264ce171412a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:00.897405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9a78c-047b-4ecb-83c2-264ce171412a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:00.897682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9a78c-047b-4ecb-83c2-264ce171412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:00.915989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a0e9a78c-047b-4ecb-83c2-264ce171412a None None] MFA Rules not processed for user `9b2db60c511f4fd29b772ca5fb014d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:00.917354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a0e9a78c-047b-4ecb-83c2-264ce171412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:00.940326 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1128/2242] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:49:00.966146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fb65d-6f7f-49e9-b354-62ce36c71b34 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:00.968026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-775fb65d-6f7f-49e9-b354-62ce36c71b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:00.987111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1115/2243] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:49:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:49:00.991591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fb65d-6f7f-49e9-b354-62ce36c71b34 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:00.999137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9a78c-047b-4ecb-83c2-264ce171412a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:01.000589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a0e9a78c-047b-4ecb-83c2-264ce171412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:01.003415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67f532-9a7b-419c-97c7-ca1b95422071 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:01.004603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67f532-9a7b-419c-97c7-ca1b95422071 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:01.004953 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67f532-9a7b-419c-97c7-ca1b95422071 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:01.005255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67f532-9a7b-419c-97c7-ca1b95422071 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:01.012628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9a78c-047b-4ecb-83c2-264ce171412a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:01.014383 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67f532-9a7b-419c-97c7-ca1b95422071 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:01.016233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67f532-9a7b-419c-97c7-ca1b95422071 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:01.016544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f094b4f-8949-4954-b6d7-1a8bd78dfdac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:01.017187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f094b4f-8949-4954-b6d7-1a8bd78dfdac service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:01.017472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f094b4f-8949-4954-b6d7-1a8bd78dfdac service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:01.017781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f094b4f-8949-4954-b6d7-1a8bd78dfdac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:01.025643 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f094b4f-8949-4954-b6d7-1a8bd78dfdac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:01.026748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1129/2244] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:49:01.027179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f094b4f-8949-4954-b6d7-1a8bd78dfdac service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:01.035692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1116/2245] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:49:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:49:01.123647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fa406-fbb8-413e-a13c-729d9dd2a652 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:01.123946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fa406-fbb8-413e-a13c-729d9dd2a652 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:01.124232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75fa406-fbb8-413e-a13c-729d9dd2a652 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:01.125628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1130/2246] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 09:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:49:01.131182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda1d8-7955-47da-857e-5822d5fc3fb2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:01.131477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda1d8-7955-47da-857e-5822d5fc3fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:01.131758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeda1d8-7955-47da-857e-5822d5fc3fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:01.155323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-eaeda1d8-7955-47da-857e-5822d5fc3fb2 None None] MFA Rules not processed for user `0422e6863c7147b79ea4d194e6e07154`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:01.155323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-eaeda1d8-7955-47da-857e-5822d5fc3fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:01.161786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1117/2247] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 09:49:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:01.172122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fa406-fbb8-413e-a13c-729d9dd2a652 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:01.183875 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75fa406-fbb8-413e-a13c-729d9dd2a652 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:01.187514 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b004f-0b6c-48c6-a1fb-547e477e97f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:01.189835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b004f-0b6c-48c6-a1fb-547e477e97f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:01.189835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b004f-0b6c-48c6-a1fb-547e477e97f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:01.189835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b004f-0b6c-48c6-a1fb-547e477e97f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:01.200567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b004f-0b6c-48c6-a1fb-547e477e97f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:01.202042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b004f-0b6c-48c6-a1fb-547e477e97f9 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:01.213205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1131/2248] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:49:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:49:06.022034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeda1d8-7955-47da-857e-5822d5fc3fb2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:06.024105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-eaeda1d8-7955-47da-857e-5822d5fc3fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:06.119648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeda1d8-7955-47da-857e-5822d5fc3fb2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:06.124870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:06.125525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:06.125813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:06.126095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:06.127953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:06.139632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:06.141574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:06.152128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1118/2249] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:49:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:49:06.245829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac4813-5093-4fdd-bb4e-fc0701bedd7b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:06.246349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac4813-5093-4fdd-bb4e-fc0701bedd7b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:06.246433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac4813-5093-4fdd-bb4e-fc0701bedd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:06.264687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-05ac4813-5093-4fdd-bb4e-fc0701bedd7b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:06.266175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-05ac4813-5093-4fdd-bb4e-fc0701bedd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:06.277004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1132/2250] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:06.305592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:06.307126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:06.323813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e7a39-e20c-4636-916b-227c1e30722c service placement] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:06.329415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1182184-a8de-4bd8-8bbb-72390753659d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:06.333438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1182184-a8de-4bd8-8bbb-72390753659d service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:06.333438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1182184-a8de-4bd8-8bbb-72390753659d service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:06.333438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1182184-a8de-4bd8-8bbb-72390753659d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:06.340562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1182184-a8de-4bd8-8bbb-72390753659d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:06.342213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1182184-a8de-4bd8-8bbb-72390753659d service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:06.354013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1119/2251] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:49:09.148767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac4813-5093-4fdd-bb4e-fc0701bedd7b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:09.158612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac4813-5093-4fdd-bb4e-fc0701bedd7b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:09.163517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:09.167464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:09.167464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:09.167464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] PATH_INFO: `/v3/users/7e9fb58dc6a3488a9af277bb7940e13d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:09.167464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e9fb58dc6a3488a9af277bb7940e13d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:09.168291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:09.401545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e9fb58dc6a3488a9af277bb7940e13d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:09.403500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:09.413696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e9fb58dc6a3488a9af277bb7940e13d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:09.514674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e9fb58dc6a3488a9af277bb7940e13d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:09.515734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e9fb58dc6a3488a9af277bb7940e13d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:09.523312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e9fb58dc6a3488a9af277bb7940e13d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:09.529166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1133/2252] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:49:09 2022] DELETE /identity/v3/users/7e9fb58dc6a3488a9af277bb7940e13d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:49:09.533658 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafdde3-ab43-4278-97b8-ba285fbb1e18 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:09.534230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafdde3-ab43-4278-97b8-ba285fbb1e18 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:09.534338 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafdde3-ab43-4278-97b8-ba285fbb1e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:09.551892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-cfafdde3-ab43-4278-97b8-ba285fbb1e18 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:09.554698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cfafdde3-ab43-4278-97b8-ba285fbb1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:09.559650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:09.619389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1120/2253] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:09.626263 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:09.628532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:09.689058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f6f86-dab1-4955-bf21-8da5b6391a47 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:09.693044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3e2a2-eab3-4615-a992-4f773684a032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:09.703043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3e2a2-eab3-4615-a992-4f773684a032 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:09.703043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3e2a2-eab3-4615-a992-4f773684a032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:09.703043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3e2a2-eab3-4615-a992-4f773684a032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:09.704111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3e2a2-eab3-4615-a992-4f773684a032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:09.705594 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3e2a2-eab3-4615-a992-4f773684a032 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:09.716122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1134/2254] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:49:10.214475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafdde3-ab43-4278-97b8-ba285fbb1e18 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:10.215902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cfafdde3-ab43-4278-97b8-ba285fbb1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:10.229414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafdde3-ab43-4278-97b8-ba285fbb1e18 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:10.234712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:10.235784 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:10.236073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:10.236348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] PATH_INFO: `/v3/projects/24597948c00f4c2fa40b4e36675e17b4` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:10.237649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24597948c00f4c2fa40b4e36675e17b4)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:10.240325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:10.394199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24597948c00f4c2fa40b4e36675e17b4', 'request_id': 'req-70f73b59-553b-434c-aa3b-3df7e66acae4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:10.405591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24597948c00f4c2fa40b4e36675e17b4', 'request_id': 'req-70f73b59-553b-434c-aa3b-3df7e66acae4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:10.480752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24597948c00f4c2fa40b4e36675e17b4', 'request_id': 'req-70f73b59-553b-434c-aa3b-3df7e66acae4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:10.494671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] The token cache is being invalidate because project 24597948c00f4c2fa40b4e36675e17b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:49:10.495118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:10.495781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-70f73b59-553b-434c-aa3b-3df7e66acae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:49:10.499803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1121/2255] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:49:10 2022] DELETE /identity/v3/projects/24597948c00f4c2fa40b4e36675e17b4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:49:10.503931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce1e33-0cae-409d-9366-08e70ab69aaa None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:10.504924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce1e33-0cae-409d-9366-08e70ab69aaa None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:10.505305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce1e33-0cae-409d-9366-08e70ab69aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:10.527207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ddce1e33-0cae-409d-9366-08e70ab69aaa None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:10.532862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ddce1e33-0cae-409d-9366-08e70ab69aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:10.599128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1135/2256] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:10.605635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a58921-22f4-40b2-99a2-0a8097c89831 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:10.606111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a58921-22f4-40b2-99a2-0a8097c89831 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:10.606219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a58921-22f4-40b2-99a2-0a8097c89831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:10.625221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-83a58921-22f4-40b2-99a2-0a8097c89831 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:10.626442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-83a58921-22f4-40b2-99a2-0a8097c89831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:10.635094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1122/2257] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:10.639239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce1e33-0cae-409d-9366-08e70ab69aaa None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:10.649743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce1e33-0cae-409d-9366-08e70ab69aaa None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:10.657336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc1c71-9801-41c0-8fd6-7a2e9903f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:10.657336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc1c71-9801-41c0-8fd6-7a2e9903f4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:10.657336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc1c71-9801-41c0-8fd6-7a2e9903f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:10.657336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc1c71-9801-41c0-8fd6-7a2e9903f4b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:10.657904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc1c71-9801-41c0-8fd6-7a2e9903f4b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:49:10.657904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc1c71-9801-41c0-8fd6-7a2e9903f4b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:10.658309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc1c71-9801-41c0-8fd6-7a2e9903f4b0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:10.670897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1136/2258] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:49:10.674961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a58921-22f4-40b2-99a2-0a8097c89831 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:10.684950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a58921-22f4-40b2-99a2-0a8097c89831 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:10.691309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53926f23-d80a-4162-a7c5-2f6957c3b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:10.691309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53926f23-d80a-4162-a7c5-2f6957c3b75d admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:10.691309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53926f23-d80a-4162-a7c5-2f6957c3b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:10.691309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53926f23-d80a-4162-a7c5-2f6957c3b75d admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:10.692104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53926f23-d80a-4162-a7c5-2f6957c3b75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:10.694782 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53926f23-d80a-4162-a7c5-2f6957c3b75d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:10.773573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1123/2259] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:49:10 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:49:10.777592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc1c71-9801-41c0-8fd6-7a2e9903f4b0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:10.787799 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc1c71-9801-41c0-8fd6-7a2e9903f4b0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:10.838011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:10.843807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ec9b1-6909-4250-9e3c-b8f64d2d7312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:10.844471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ec9b1-6909-4250-9e3c-b8f64d2d7312 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:10.844761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ec9b1-6909-4250-9e3c-b8f64d2d7312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:10.845041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ec9b1-6909-4250-9e3c-b8f64d2d7312 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:10.845723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ec9b1-6909-4250-9e3c-b8f64d2d7312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:10.847684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ec9b1-6909-4250-9e3c-b8f64d2d7312 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:10.973390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1137/2260] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:49:10 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:49:10.974972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53926f23-d80a-4162-a7c5-2f6957c3b75d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:10.985313 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53926f23-d80a-4162-a7c5-2f6957c3b75d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:10.989965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bb49f-4b37-4851-95d2-8c1878180343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:10.991163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bb49f-4b37-4851-95d2-8c1878180343 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:10.991447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bb49f-4b37-4851-95d2-8c1878180343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:10.991893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bb49f-4b37-4851-95d2-8c1878180343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:10.992628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bb49f-4b37-4851-95d2-8c1878180343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:10.994275 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bb49f-4b37-4851-95d2-8c1878180343 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:11.004945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1124/2261] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:49:11.009566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ec9b1-6909-4250-9e3c-b8f64d2d7312 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:11.020774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ec9b1-6909-4250-9e3c-b8f64d2d7312 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:11.028456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d0820-dc12-4cdf-bb44-7aa1e7770b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:11.028456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d0820-dc12-4cdf-bb44-7aa1e7770b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:11.028456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d0820-dc12-4cdf-bb44-7aa1e7770b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:11.028456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d0820-dc12-4cdf-bb44-7aa1e7770b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:11.029285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d0820-dc12-4cdf-bb44-7aa1e7770b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:11.029705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d0820-dc12-4cdf-bb44-7aa1e7770b69 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:11.041881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1138/2262] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:49:11.046235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bb49f-4b37-4851-95d2-8c1878180343 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:11.057199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bb49f-4b37-4851-95d2-8c1878180343 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:11.061813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c8535-e7d3-450b-984b-3c779fc300fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:11.062695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c8535-e7d3-450b-984b-3c779fc300fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:11.063017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c8535-e7d3-450b-984b-3c779fc300fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:11.063295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393c8535-e7d3-450b-984b-3c779fc300fc admin admin] PATH_INFO: `/v3/projects/e0862c77c1cf4966900fcdd395840c7d/users/1d89d6e107ef46008c12eeeeb36688c5/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:11.078543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c8535-e7d3-450b-984b-3c779fc300fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0862c77c1cf4966900fcdd395840c7d, user_id=1d89d6e107ef46008c12eeeeb36688c5, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:11.081301 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393c8535-e7d3-450b-984b-3c779fc300fc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:11.149996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1125/2263] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:49:11 2022] PUT /identity/v3/projects/e0862c77c1cf4966900fcdd395840c7d/users/1d89d6e107ef46008c12eeeeb36688c5/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:49:11.155031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac3812-fdfb-45cc-80fd-484ea4855863 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:11.155328 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac3812-fdfb-45cc-80fd-484ea4855863 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:11.160339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac3812-fdfb-45cc-80fd-484ea4855863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:11.172751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d4ac3812-fdfb-45cc-80fd-484ea4855863 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:11.173951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d4ac3812-fdfb-45cc-80fd-484ea4855863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:11.233565 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1139/2264] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:11.243665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c8535-e7d3-450b-984b-3c779fc300fc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:11.245374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-393c8535-e7d3-450b-984b-3c779fc300fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:11.280707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:11.303451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393c8535-e7d3-450b-984b-3c779fc300fc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:11.307099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d621-96b4-4cae-a782-8992403b3f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:11.307768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d621-96b4-4cae-a782-8992403b3f45 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:11.308100 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d621-96b4-4cae-a782-8992403b3f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:11.308383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3d621-96b4-4cae-a782-8992403b3f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:11.317731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3d621-96b4-4cae-a782-8992403b3f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:11.319757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3d621-96b4-4cae-a782-8992403b3f45 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:11.329319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1126/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:49:13.584327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1abdf-0ea8-4c8f-8002-bc9b80c967ab None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:13.585497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1abdf-0ea8-4c8f-8002-bc9b80c967ab None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:13.586201 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1abdf-0ea8-4c8f-8002-bc9b80c967ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:13.649954 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-15c1abdf-0ea8-4c8f-8002-bc9b80c967ab None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:13.651312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-15c1abdf-0ea8-4c8f-8002-bc9b80c967ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:13.747626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1140/2266] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:49:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:13.759937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d621-96b4-4cae-a782-8992403b3f45 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:13.761333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ffa3d621-96b4-4cae-a782-8992403b3f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:13.932812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3d621-96b4-4cae-a782-8992403b3f45 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:13.948026 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7c29c-a42c-457b-bd2b-85268af43a75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:13.948698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7c29c-a42c-457b-bd2b-85268af43a75 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:13.948984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7c29c-a42c-457b-bd2b-85268af43a75 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:13.949290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a7c29c-a42c-457b-bd2b-85268af43a75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:13.960209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7c29c-a42c-457b-bd2b-85268af43a75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:13.962626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a7c29c-a42c-457b-bd2b-85268af43a75 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:13.972128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1127/2267] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:49:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 09:49:18.219710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de5f94-49b6-4754-bc8e-d2665b0fd016 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:18.220254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de5f94-49b6-4754-bc8e-d2665b0fd016 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:18.220254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de5f94-49b6-4754-bc8e-d2665b0fd016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:18.253373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-48de5f94-49b6-4754-bc8e-d2665b0fd016 None None] MFA Rules not processed for user `1d89d6e107ef46008c12eeeeb36688c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:18.254613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-48de5f94-49b6-4754-bc8e-d2665b0fd016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:18.295275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:18.332175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1141/2268] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:18.337083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7c29c-a42c-457b-bd2b-85268af43a75 service swift] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:18.354207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a7c29c-a42c-457b-bd2b-85268af43a75 service swift] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:18.361888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8267bd-744e-449c-93b8-b120e035cf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:18.364228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8267bd-744e-449c-93b8-b120e035cf06 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:18.364228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8267bd-744e-449c-93b8-b120e035cf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:18.364228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8267bd-744e-449c-93b8-b120e035cf06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:18.364228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8267bd-744e-449c-93b8-b120e035cf06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:18.366763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8267bd-744e-449c-93b8-b120e035cf06 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:18.498339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1128/2269] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:49:18 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:49:18.499055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de5f94-49b6-4754-bc8e-d2665b0fd016 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:18.511961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de5f94-49b6-4754-bc8e-d2665b0fd016 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:18.598415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273971cc-831c-4c51-b33d-6f07b5a516d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:18.601023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273971cc-831c-4c51-b33d-6f07b5a516d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:18.601023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273971cc-831c-4c51-b33d-6f07b5a516d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:18.601537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273971cc-831c-4c51-b33d-6f07b5a516d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:18.602273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273971cc-831c-4c51-b33d-6f07b5a516d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:18.604315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273971cc-831c-4c51-b33d-6f07b5a516d9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:18.680965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1142/2270] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:49:18 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:49:18.684860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8267bd-744e-449c-93b8-b120e035cf06 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:18.696085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8267bd-744e-449c-93b8-b120e035cf06 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:18.700747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72f31d-491d-4267-b64a-d84e730db783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:18.701410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72f31d-491d-4267-b64a-d84e730db783 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:18.701693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72f31d-491d-4267-b64a-d84e730db783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:18.701972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72f31d-491d-4267-b64a-d84e730db783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:18.702705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72f31d-491d-4267-b64a-d84e730db783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:18.704379 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72f31d-491d-4267-b64a-d84e730db783 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:18.715293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1129/2271] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:49:18.719469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273971cc-831c-4c51-b33d-6f07b5a516d9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:18.730000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273971cc-831c-4c51-b33d-6f07b5a516d9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:18.734881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5771231-dd30-454e-a322-1a8ae1fbff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:18.735888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5771231-dd30-454e-a322-1a8ae1fbff62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:18.736207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5771231-dd30-454e-a322-1a8ae1fbff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:18.736488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5771231-dd30-454e-a322-1a8ae1fbff62 admin admin] PATH_INFO: `/v3/projects/f4a8b3c567d14bb6bd7271081b960105/users/524e3049088e49efbaf46ef548631eca/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:18.751595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5771231-dd30-454e-a322-1a8ae1fbff62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a8b3c567d14bb6bd7271081b960105, user_id=524e3049088e49efbaf46ef548631eca, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:18.754257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5771231-dd30-454e-a322-1a8ae1fbff62 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:18.853051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1143/2272] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:49:18 2022] PUT /identity/v3/projects/f4a8b3c567d14bb6bd7271081b960105/users/524e3049088e49efbaf46ef548631eca/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:49:18.856976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72f31d-491d-4267-b64a-d84e730db783 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:18.867108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72f31d-491d-4267-b64a-d84e730db783 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:18.927085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59480819-f489-45d3-921c-6b901bffc5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:18.927788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480819-f489-45d3-921c-6b901bffc5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:18.928191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480819-f489-45d3-921c-6b901bffc5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:18.928427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59480819-f489-45d3-921c-6b901bffc5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:18.929236 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59480819-f489-45d3-921c-6b901bffc5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:18.930902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59480819-f489-45d3-921c-6b901bffc5d1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:18.940923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1130/2273] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:49:18.945708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5771231-dd30-454e-a322-1a8ae1fbff62 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:18.956472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5771231-dd30-454e-a322-1a8ae1fbff62 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:18.962045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b868d1e-dc73-4bda-bc76-00dee9414f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:18.962971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b868d1e-dc73-4bda-bc76-00dee9414f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:18.963266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b868d1e-dc73-4bda-bc76-00dee9414f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:18.963540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b868d1e-dc73-4bda-bc76-00dee9414f13 admin admin] PATH_INFO: `/v3/projects/f4a8b3c567d14bb6bd7271081b960105/users/524e3049088e49efbaf46ef548631eca/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:18.965627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b868d1e-dc73-4bda-bc76-00dee9414f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a8b3c567d14bb6bd7271081b960105, user_id=524e3049088e49efbaf46ef548631eca, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:18.968330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b868d1e-dc73-4bda-bc76-00dee9414f13 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:18.979901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1144/2274] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:49:18 2022] PUT /identity/v3/projects/f4a8b3c567d14bb6bd7271081b960105/users/524e3049088e49efbaf46ef548631eca/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:49:26.761290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b42d7-c7a7-4f69-923a-b83da376ab65 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:26.762337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b42d7-c7a7-4f69-923a-b83da376ab65 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:26.762802 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b42d7-c7a7-4f69-923a-b83da376ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:26.801108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:26.825964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7a2b42d7-c7a7-4f69-923a-b83da376ab65 None None] MFA Rules not processed for user `524e3049088e49efbaf46ef548631eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:26.827715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7a2b42d7-c7a7-4f69-923a-b83da376ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:27.030997 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1131/2275] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:27.618473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b868d1e-dc73-4bda-bc76-00dee9414f13 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:27.622378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7b868d1e-dc73-4bda-bc76-00dee9414f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:27.721173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b868d1e-dc73-4bda-bc76-00dee9414f13 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:27.730884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223786c-9fb8-4cc5-938d-90946d1c78d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:27.730884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223786c-9fb8-4cc5-938d-90946d1c78d4 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:27.730884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223786c-9fb8-4cc5-938d-90946d1c78d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:27.730884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223786c-9fb8-4cc5-938d-90946d1c78d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:27.783108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:27.825804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223786c-9fb8-4cc5-938d-90946d1c78d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:27.827455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223786c-9fb8-4cc5-938d-90946d1c78d4 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:27.838073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1145/2276] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:49:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:49:29.911304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646e325-06f9-4113-a7f8-60cab486cd48 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:29.911931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646e325-06f9-4113-a7f8-60cab486cd48 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:29.912906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646e325-06f9-4113-a7f8-60cab486cd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:29.947864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2646e325-06f9-4113-a7f8-60cab486cd48 None None] MFA Rules not processed for user `51e583787db9460f976194a1e498d415`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:29.953390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2646e325-06f9-4113-a7f8-60cab486cd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:30.044410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1132/2277] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:31.863709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e00f90-ebc1-4dc4-956f-5b265af6bf8b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:31.864257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e00f90-ebc1-4dc4-956f-5b265af6bf8b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:31.864257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e00f90-ebc1-4dc4-956f-5b265af6bf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:31.884130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f8e00f90-ebc1-4dc4-956f-5b265af6bf8b None None] MFA Rules not processed for user `1d89d6e107ef46008c12eeeeb36688c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:31.885370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f8e00f90-ebc1-4dc4-956f-5b265af6bf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:31.894546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1146/2278] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:40.031880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=56 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:41.258753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27afa56-ce74-4f49-8fb0-63465fd38481 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:41.259457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27afa56-ce74-4f49-8fb0-63465fd38481 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:41.259457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27afa56-ce74-4f49-8fb0-63465fd38481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:41.277174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b27afa56-ce74-4f49-8fb0-63465fd38481 None None] MFA Rules not processed for user `e24f6665d95e48c7b694d19b0dd132e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:41.278298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b27afa56-ce74-4f49-8fb0-63465fd38481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:41.355497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1133/2279] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:41.358115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f150c-c176-4008-b57d-88c8fcfe9169 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:41.358608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f150c-c176-4008-b57d-88c8fcfe9169 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:41.358726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f150c-c176-4008-b57d-88c8fcfe9169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:41.382273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-de1f150c-c176-4008-b57d-88c8fcfe9169 None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:41.383824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-de1f150c-c176-4008-b57d-88c8fcfe9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:41.465603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1147/2280] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 09:49:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:41.492098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27afa56-ce74-4f49-8fb0-63465fd38481 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:41.564014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27afa56-ce74-4f49-8fb0-63465fd38481 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:41.569213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec092d15-1211-4897-aaaf-33ce9a744d48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:41.569862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec092d15-1211-4897-aaaf-33ce9a744d48 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:41.570142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec092d15-1211-4897-aaaf-33ce9a744d48 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:41.570414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec092d15-1211-4897-aaaf-33ce9a744d48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:41.578815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec092d15-1211-4897-aaaf-33ce9a744d48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:41.580555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec092d15-1211-4897-aaaf-33ce9a744d48 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:41.589382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1134/2281] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:49:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:49:51.459045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=43 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:51.586033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=57 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:49:54.332176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332baaf5-4137-4980-8cea-a03d23c520a7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:54.332715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332baaf5-4137-4980-8cea-a03d23c520a7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:54.332812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332baaf5-4137-4980-8cea-a03d23c520a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:54.351842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-332baaf5-4137-4980-8cea-a03d23c520a7 None None] MFA Rules not processed for user `cbb22c3df9e9452db19974f52d3ebb17`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:54.353056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-332baaf5-4137-4980-8cea-a03d23c520a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:54.409340 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1148/2282] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:49:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:58.719978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73462bc0-83d6-41c3-a877-780da703b7cc None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:58.720378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73462bc0-83d6-41c3-a877-780da703b7cc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:58.720524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73462bc0-83d6-41c3-a877-780da703b7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:58.743066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-73462bc0-83d6-41c3-a877-780da703b7cc None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:49:58.749433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-73462bc0-83d6-41c3-a877-780da703b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:49:58.758827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1135/2283] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:49:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:49:58.771923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332baaf5-4137-4980-8cea-a03d23c520a7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:49:58.787623 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332baaf5-4137-4980-8cea-a03d23c520a7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:49:58.798325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1596f2-492e-4492-afa0-fdafd7302648 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:49:58.799206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1596f2-492e-4492-afa0-fdafd7302648 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:49:58.799599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1596f2-492e-4492-afa0-fdafd7302648 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:49:58.799985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1596f2-492e-4492-afa0-fdafd7302648 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:49:58.809998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1596f2-492e-4492-afa0-fdafd7302648 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:49:58.811716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1596f2-492e-4492-afa0-fdafd7302648 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:49:58.821669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1149/2284] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:49:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:50:08.733537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:08.817183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=31 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:08.916271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73462bc0-83d6-41c3-a877-780da703b7cc None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:08.916831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-73462bc0-83d6-41c3-a877-780da703b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:08.998245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73462bc0-83d6-41c3-a877-780da703b7cc None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:09.002276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65e4a-f7b8-4c86-8d82-8927547fb2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:09.003356 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65e4a-f7b8-4c86-8d82-8927547fb2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:09.003356 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65e4a-f7b8-4c86-8d82-8927547fb2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:09.003742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb65e4a-f7b8-4c86-8d82-8927547fb2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:09.015874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65e4a-f7b8-4c86-8d82-8927547fb2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:09.017596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb65e4a-f7b8-4c86-8d82-8927547fb2e0 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:09.029485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1136/2285] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:50:11.175544 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc02932-f471-4784-96bd-2def1949cd20 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:11.179406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc02932-f471-4784-96bd-2def1949cd20 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:11.180680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc02932-f471-4784-96bd-2def1949cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:11.213059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ebc02932-f471-4784-96bd-2def1949cd20 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:11.214707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ebc02932-f471-4784-96bd-2def1949cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:11.336238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1150/2286] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:11.366230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65e4a-f7b8-4c86-8d82-8927547fb2e0 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:11.380301 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb65e4a-f7b8-4c86-8d82-8927547fb2e0 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:11.386646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2142ca2-1c47-475a-b229-9baafcc2fa1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:11.387573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2142ca2-1c47-475a-b229-9baafcc2fa1a service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:11.388006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2142ca2-1c47-475a-b229-9baafcc2fa1a service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:11.388442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2142ca2-1c47-475a-b229-9baafcc2fa1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:11.398979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2142ca2-1c47-475a-b229-9baafcc2fa1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:11.404052 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2142ca2-1c47-475a-b229-9baafcc2fa1a service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:11.420706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1137/2287] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:50:17.523651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef761d-7f79-4bbd-bc96-94fb8c027b91 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:17.524957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef761d-7f79-4bbd-bc96-94fb8c027b91 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:17.524957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef761d-7f79-4bbd-bc96-94fb8c027b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:17.546400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cfef761d-7f79-4bbd-bc96-94fb8c027b91 None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:17.546400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cfef761d-7f79-4bbd-bc96-94fb8c027b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:17.553880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1151/2288] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 09:50:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:17.566628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2142ca2-1c47-475a-b229-9baafcc2fa1a service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:17.580602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2142ca2-1c47-475a-b229-9baafcc2fa1a service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:17.584799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25c726-474e-4ab2-8144-0adad6fceca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:17.585510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25c726-474e-4ab2-8144-0adad6fceca6 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:17.585799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25c726-474e-4ab2-8144-0adad6fceca6 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:17.586085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25c726-474e-4ab2-8144-0adad6fceca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:17.595117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25c726-474e-4ab2-8144-0adad6fceca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:17.596750 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25c726-474e-4ab2-8144-0adad6fceca6 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:17.605727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1138/2289] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:50:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:50:19.399375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352e16-4fa8-4e17-9ac0-949273f782eb None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:19.399876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352e16-4fa8-4e17-9ac0-949273f782eb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:19.399978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16352e16-4fa8-4e17-9ac0-949273f782eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:19.417889 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-16352e16-4fa8-4e17-9ac0-949273f782eb None None] MFA Rules not processed for user `2cdef290abf8487ab370969a5e5b76c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:19.419122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-16352e16-4fa8-4e17-9ac0-949273f782eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:19.474584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1152/2290] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:20.802735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a82e-88ab-4a6d-b477-fc2ba9809260 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:20.803323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a82e-88ab-4a6d-b477-fc2ba9809260 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:20.803323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082a82e-88ab-4a6d-b477-fc2ba9809260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:20.822529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7082a82e-88ab-4a6d-b477-fc2ba9809260 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:20.823904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7082a82e-88ab-4a6d-b477-fc2ba9809260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:20.832439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1139/2291] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:20.860731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16352e16-4fa8-4e17-9ac0-949273f782eb None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:20.862245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-16352e16-4fa8-4e17-9ac0-949273f782eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:20.878960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16352e16-4fa8-4e17-9ac0-949273f782eb None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:20.885281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6565828-1bcb-498a-9ef5-59d28b269b04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:20.890524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6565828-1bcb-498a-9ef5-59d28b269b04 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:20.890524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6565828-1bcb-498a-9ef5-59d28b269b04 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:20.890524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6565828-1bcb-498a-9ef5-59d28b269b04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:20.895880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6565828-1bcb-498a-9ef5-59d28b269b04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:20.897477 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6565828-1bcb-498a-9ef5-59d28b269b04 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:20.907352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1153/2292] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:50:21.009095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082a82e-88ab-4a6d-b477-fc2ba9809260 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:21.011035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7082a82e-88ab-4a6d-b477-fc2ba9809260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:21.025408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082a82e-88ab-4a6d-b477-fc2ba9809260 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:21.030551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:21.031518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:21.031809 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:21.032092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] PATH_INFO: `/v3/users/51e583787db9460f976194a1e498d415` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:21.033313 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e583787db9460f976194a1e498d415)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:21.035474 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:21.229501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e583787db9460f976194a1e498d415'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.230194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e583787db9460f976194a1e498d415'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.242729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e583787db9460f976194a1e498d415'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.249777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e583787db9460f976194a1e498d415'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.329448 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-890011fe-f07d-4385-b758-f865ffd711f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e583787db9460f976194a1e498d415'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.338599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1140/2293] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:50:21 2022] DELETE /identity/v3/users/51e583787db9460f976194a1e498d415 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:50:21.599211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6565828-1bcb-498a-9ef5-59d28b269b04 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:21.609482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6565828-1bcb-498a-9ef5-59d28b269b04 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:21.669738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:21.670595 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:21.670912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:21.671192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] PATH_INFO: `/v3/projects/b9b47761431c408480f2be11fd613a61` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:21.672369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b47761431c408480f2be11fd613a61)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:21.674254 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:21.787808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:21.802512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b47761431c408480f2be11fd613a61', 'request_id': 'req-7d0cff70-ef56-4068-8800-22810d857d20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.883118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b47761431c408480f2be11fd613a61', 'request_id': 'req-7d0cff70-ef56-4068-8800-22810d857d20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.888681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b47761431c408480f2be11fd613a61', 'request_id': 'req-7d0cff70-ef56-4068-8800-22810d857d20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.901100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] The token cache is being invalidate because project b9b47761431c408480f2be11fd613a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:50:21.901383 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.902005 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7d0cff70-ef56-4068-8800-22810d857d20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:21.903584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1154/2294] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:50:21 2022] DELETE /identity/v3/projects/b9b47761431c408480f2be11fd613a61 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:50:21.908463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb131-f4ce-4ec0-abbd-8aec08624136 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:21.908909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb131-f4ce-4ec0-abbd-8aec08624136 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:21.909028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbb131-f4ce-4ec0-abbd-8aec08624136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:21.927566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-68cbb131-f4ce-4ec0-abbd-8aec08624136 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:21.928772 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-68cbb131-f4ce-4ec0-abbd-8aec08624136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:21.967172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:21.987540 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1141/2295] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:21.995823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97c522-b5a3-469b-90f8-39ac2df9e6c8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:21.996113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97c522-b5a3-469b-90f8-39ac2df9e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:21.996395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97c522-b5a3-469b-90f8-39ac2df9e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:22.015929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0d97c522-b5a3-469b-90f8-39ac2df9e6c8 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:22.017133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0d97c522-b5a3-469b-90f8-39ac2df9e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:22.025454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1155/2296] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:22.029467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb131-f4ce-4ec0-abbd-8aec08624136 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:22.038941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbb131-f4ce-4ec0-abbd-8aec08624136 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:22.043636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87ab37-9475-458a-a3e9-9d963339ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:22.044286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87ab37-9475-458a-a3e9-9d963339ea01 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:22.044576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87ab37-9475-458a-a3e9-9d963339ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:22.044852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f87ab37-9475-458a-a3e9-9d963339ea01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:22.045579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87ab37-9475-458a-a3e9-9d963339ea01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:50:22.045894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87ab37-9475-458a-a3e9-9d963339ea01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:22.047558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f87ab37-9475-458a-a3e9-9d963339ea01 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:22.059870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1142/2297] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:50:22.064299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97c522-b5a3-469b-90f8-39ac2df9e6c8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:22.074164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97c522-b5a3-469b-90f8-39ac2df9e6c8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:22.079003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbced2-be19-4868-b2eb-021dc9dd25fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:22.079658 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbced2-be19-4868-b2eb-021dc9dd25fc admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:22.082298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbced2-be19-4868-b2eb-021dc9dd25fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:22.082298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbced2-be19-4868-b2eb-021dc9dd25fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:22.082298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbced2-be19-4868-b2eb-021dc9dd25fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:22.083069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbced2-be19-4868-b2eb-021dc9dd25fc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:22.167432 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1156/2298] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:50:22 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:50:22.170110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87ab37-9475-458a-a3e9-9d963339ea01 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:22.179815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f87ab37-9475-458a-a3e9-9d963339ea01 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:22.241693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf8646-c6b4-4345-acd6-cca29c6a996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:22.242485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf8646-c6b4-4345-acd6-cca29c6a996a admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:22.242778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf8646-c6b4-4345-acd6-cca29c6a996a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:22.243095 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf8646-c6b4-4345-acd6-cca29c6a996a admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:22.243808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf8646-c6b4-4345-acd6-cca29c6a996a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:22.245860 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf8646-c6b4-4345-acd6-cca29c6a996a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:22.324910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1143/2299] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:50:22 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:50:22.329090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbced2-be19-4868-b2eb-021dc9dd25fc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:22.339546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbced2-be19-4868-b2eb-021dc9dd25fc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:22.344193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a893-95cc-4610-8487-3ff5a2434b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:22.344867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a893-95cc-4610-8487-3ff5a2434b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:22.345140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a893-95cc-4610-8487-3ff5a2434b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:22.345421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a893-95cc-4610-8487-3ff5a2434b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:22.346152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a893-95cc-4610-8487-3ff5a2434b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:22.347784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a893-95cc-4610-8487-3ff5a2434b06 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:22.358594 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1157/2300] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:50:22.362505 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf8646-c6b4-4345-acd6-cca29c6a996a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:22.373025 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf8646-c6b4-4345-acd6-cca29c6a996a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:22.377834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ad19d-f8a9-403f-be6e-cbdbf93c6f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:22.378709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad19d-f8a9-403f-be6e-cbdbf93c6f7b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:22.379098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad19d-f8a9-403f-be6e-cbdbf93c6f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:22.379953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ad19d-f8a9-403f-be6e-cbdbf93c6f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:22.380832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ad19d-f8a9-403f-be6e-cbdbf93c6f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:22.382439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ad19d-f8a9-403f-be6e-cbdbf93c6f7b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:22.393262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1144/2301] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:50:22.401036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a893-95cc-4610-8487-3ff5a2434b06 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:22.411758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a893-95cc-4610-8487-3ff5a2434b06 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:22.416367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a56d-0afc-40f6-8970-4b65558dcbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:22.417244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a56d-0afc-40f6-8970-4b65558dcbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:22.417532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a56d-0afc-40f6-8970-4b65558dcbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:22.417840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a56d-0afc-40f6-8970-4b65558dcbeb admin admin] PATH_INFO: `/v3/projects/be75cabf300045dbac3aad02a2fcfd6d/users/e4bc0397e20c485aa283a60b62336e02/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:22.433109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a56d-0afc-40f6-8970-4b65558dcbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=be75cabf300045dbac3aad02a2fcfd6d, user_id=e4bc0397e20c485aa283a60b62336e02, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:22.443450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a56d-0afc-40f6-8970-4b65558dcbeb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:22.528900 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1158/2302] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:50:22 2022] PUT /identity/v3/projects/be75cabf300045dbac3aad02a2fcfd6d/users/e4bc0397e20c485aa283a60b62336e02/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:50:22.538969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f891-23bb-423e-88b0-e6891c7d139f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:22.539263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f891-23bb-423e-88b0-e6891c7d139f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:22.539538 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691f891-23bb-423e-88b0-e6891c7d139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:22.568482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c691f891-23bb-423e-88b0-e6891c7d139f None None] MFA Rules not processed for user `e4bc0397e20c485aa283a60b62336e02`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:22.569717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c691f891-23bb-423e-88b0-e6891c7d139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:22.635849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1145/2303] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:22.647818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a56d-0afc-40f6-8970-4b65558dcbeb admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:22.653727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cde7a56d-0afc-40f6-8970-4b65558dcbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:22.712144 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a56d-0afc-40f6-8970-4b65558dcbeb admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:22.716123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231ca7b-69f6-4470-b235-0defec3f2274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:22.716787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ca7b-69f6-4470-b235-0defec3f2274 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:22.717073 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ca7b-69f6-4470-b235-0defec3f2274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:22.717358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231ca7b-69f6-4470-b235-0defec3f2274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:22.726788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ca7b-69f6-4470-b235-0defec3f2274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:22.728349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231ca7b-69f6-4470-b235-0defec3f2274 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:22.737600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1159/2304] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:50:25.787240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f891-23bb-423e-88b0-e6891c7d139f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:25.831365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:25.854974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691f891-23bb-423e-88b0-e6891c7d139f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:25.860072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:25.861207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:25.861921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:25.862320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] PATH_INFO: `/v3/users/e4bc0397e20c485aa283a60b62336e02` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:25.863729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4bc0397e20c485aa283a60b62336e02)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:25.865891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:26.058567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4bc0397e20c485aa283a60b62336e02'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:26.059292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4bc0397e20c485aa283a60b62336e02'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:26.072690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4bc0397e20c485aa283a60b62336e02'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:26.080001 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4bc0397e20c485aa283a60b62336e02'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:26.129717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4bc0397e20c485aa283a60b62336e02'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:26.136294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1146/2305] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:50:25 2022] DELETE /identity/v3/users/e4bc0397e20c485aa283a60b62336e02 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:50:26.141597 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fb499-4c39-423c-94d8-ece4f8078422 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:26.142090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fb499-4c39-423c-94d8-ece4f8078422 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:26.145904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fb499-4c39-423c-94d8-ece4f8078422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:26.160580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e07fb499-4c39-423c-94d8-ece4f8078422 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:26.161887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e07fb499-4c39-423c-94d8-ece4f8078422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:26.213087 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:26.224355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1160/2306] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:26.234308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:26.235873 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:26.297328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52339b1a-7f40-4e81-97fc-9ddd7a7998b6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:26.301170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc8415-f2e8-47a9-ac60-e02075169443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:26.302046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc8415-f2e8-47a9-ac60-e02075169443 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:26.302332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc8415-f2e8-47a9-ac60-e02075169443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:26.302610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc8415-f2e8-47a9-ac60-e02075169443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:26.311811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc8415-f2e8-47a9-ac60-e02075169443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:26.313252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc8415-f2e8-47a9-ac60-e02075169443 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:26.323735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1147/2307] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:50:26.703092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c60369-887f-4e60-a60b-207bcf63bb72 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:26.703500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c60369-887f-4e60-a60b-207bcf63bb72 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:26.704440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c60369-887f-4e60-a60b-207bcf63bb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:26.724233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-05c60369-887f-4e60-a60b-207bcf63bb72 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:26.725583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-05c60369-887f-4e60-a60b-207bcf63bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:26.734681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1161/2308] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:26.775519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc8415-f2e8-47a9-ac60-e02075169443 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:26.777240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-addc8415-f2e8-47a9-ac60-e02075169443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:26.839313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c60369-887f-4e60-a60b-207bcf63bb72 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:26.839313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-05c60369-887f-4e60-a60b-207bcf63bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:26.847614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:26.861329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c60369-887f-4e60-a60b-207bcf63bb72 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:26.872463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:26.872941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc8415-f2e8-47a9-ac60-e02075169443 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:26.873524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:26.873862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:26.874196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] PATH_INFO: `/v3/projects/be75cabf300045dbac3aad02a2fcfd6d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:26.875493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be75cabf300045dbac3aad02a2fcfd6d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:26.878230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:26.879748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d74235-a49c-4ba7-9483-f1d0430d2c61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:26.880607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d74235-a49c-4ba7-9483-f1d0430d2c61 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:26.880910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d74235-a49c-4ba7-9483-f1d0430d2c61 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:26.881198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d74235-a49c-4ba7-9483-f1d0430d2c61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:26.892090 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d74235-a49c-4ba7-9483-f1d0430d2c61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:26.894582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d74235-a49c-4ba7-9483-f1d0430d2c61 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:26.906867 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1148/2309] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:50:27.012741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be75cabf300045dbac3aad02a2fcfd6d', 'request_id': 'req-ed0255a1-5648-46d0-88e5-9ebf185c7444'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:27.117866 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be75cabf300045dbac3aad02a2fcfd6d', 'request_id': 'req-ed0255a1-5648-46d0-88e5-9ebf185c7444'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:27.125505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be75cabf300045dbac3aad02a2fcfd6d', 'request_id': 'req-ed0255a1-5648-46d0-88e5-9ebf185c7444'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:27.142178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] The token cache is being invalidate because project be75cabf300045dbac3aad02a2fcfd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:50:27.142911 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:27.143591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ed0255a1-5648-46d0-88e5-9ebf185c7444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:27.145611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1162/2310] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:50:26 2022] DELETE /identity/v3/projects/be75cabf300045dbac3aad02a2fcfd6d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:50:27.150464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e39c-fd37-4bd1-bf41-44e216071e0b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:27.150759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e39c-fd37-4bd1-bf41-44e216071e0b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:27.151111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25e39c-fd37-4bd1-bf41-44e216071e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:27.169180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6b25e39c-fd37-4bd1-bf41-44e216071e0b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:27.170406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6b25e39c-fd37-4bd1-bf41-44e216071e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:27.228814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1149/2311] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:27.237691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec066ed-018c-4864-a1e7-8ab63ed28360 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:27.237928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec066ed-018c-4864-a1e7-8ab63ed28360 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:27.238212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec066ed-018c-4864-a1e7-8ab63ed28360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:27.256895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9ec066ed-018c-4864-a1e7-8ab63ed28360 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:27.258088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9ec066ed-018c-4864-a1e7-8ab63ed28360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:27.266156 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1163/2312] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:27.271030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25e39c-fd37-4bd1-bf41-44e216071e0b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:27.280858 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25e39c-fd37-4bd1-bf41-44e216071e0b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:27.286050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da74fb6-2d3c-443a-a498-6516818c45c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:27.286705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74fb6-2d3c-443a-a498-6516818c45c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:27.287033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74fb6-2d3c-443a-a498-6516818c45c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:27.287314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da74fb6-2d3c-443a-a498-6516818c45c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:27.288106 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da74fb6-2d3c-443a-a498-6516818c45c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:50:27.288416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da74fb6-2d3c-443a-a498-6516818c45c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:27.290020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da74fb6-2d3c-443a-a498-6516818c45c6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:27.301610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1150/2313] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:50:27.305906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec066ed-018c-4864-a1e7-8ab63ed28360 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:27.315161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec066ed-018c-4864-a1e7-8ab63ed28360 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:27.319965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7ff5b-5377-4554-a249-a0854c8daf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:27.320610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7ff5b-5377-4554-a249-a0854c8daf90 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:27.320898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7ff5b-5377-4554-a249-a0854c8daf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:27.321174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7ff5b-5377-4554-a249-a0854c8daf90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:27.321855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7ff5b-5377-4554-a249-a0854c8daf90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:27.323794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f7ff5b-5377-4554-a249-a0854c8daf90 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:27.411946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1164/2314] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:50:27 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:50:27.416187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da74fb6-2d3c-443a-a498-6516818c45c6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:27.426367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da74fb6-2d3c-443a-a498-6516818c45c6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:27.482537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489db99-bd57-4b0d-83e6-547da1d909cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:27.483231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489db99-bd57-4b0d-83e6-547da1d909cf admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:27.483514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489db99-bd57-4b0d-83e6-547da1d909cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:27.484614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4489db99-bd57-4b0d-83e6-547da1d909cf admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:27.485318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489db99-bd57-4b0d-83e6-547da1d909cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:27.487253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4489db99-bd57-4b0d-83e6-547da1d909cf admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:27.562310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1151/2315] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:50:27 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:50:27.566815 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7ff5b-5377-4554-a249-a0854c8daf90 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:27.577456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7ff5b-5377-4554-a249-a0854c8daf90 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:27.582822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb423e9-b088-4201-9476-3dc3e1220f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:27.583568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb423e9-b088-4201-9476-3dc3e1220f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:27.583858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb423e9-b088-4201-9476-3dc3e1220f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:27.584134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb423e9-b088-4201-9476-3dc3e1220f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:27.585080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb423e9-b088-4201-9476-3dc3e1220f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:27.586691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb423e9-b088-4201-9476-3dc3e1220f83 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:27.597305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1165/2316] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:50:27.601996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489db99-bd57-4b0d-83e6-547da1d909cf admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:27.612218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4489db99-bd57-4b0d-83e6-547da1d909cf admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:27.617206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83add56d-9461-4c48-b746-84bd7246aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:27.617915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add56d-9461-4c48-b746-84bd7246aa7d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:27.618203 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add56d-9461-4c48-b746-84bd7246aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:27.618486 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83add56d-9461-4c48-b746-84bd7246aa7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:27.619249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83add56d-9461-4c48-b746-84bd7246aa7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:27.620867 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83add56d-9461-4c48-b746-84bd7246aa7d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:27.631213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1152/2317] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:50:27.635095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb423e9-b088-4201-9476-3dc3e1220f83 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:27.645904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb423e9-b088-4201-9476-3dc3e1220f83 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:27.650554 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dcba9-dfeb-45f7-a915-53f6a26d4f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:27.651476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dcba9-dfeb-45f7-a915-53f6a26d4f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:27.651757 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dcba9-dfeb-45f7-a915-53f6a26d4f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:27.652060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913dcba9-dfeb-45f7-a915-53f6a26d4f1b admin admin] PATH_INFO: `/v3/projects/90fe1702cf3a4ae0aad4007e275435a9/users/f9a2e5d159ae4795a30d1a6c1deea627/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:27.666915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dcba9-dfeb-45f7-a915-53f6a26d4f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=90fe1702cf3a4ae0aad4007e275435a9, user_id=f9a2e5d159ae4795a30d1a6c1deea627, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:27.669355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913dcba9-dfeb-45f7-a915-53f6a26d4f1b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:27.752124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1166/2318] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:50:27 2022] PUT /identity/v3/projects/90fe1702cf3a4ae0aad4007e275435a9/users/f9a2e5d159ae4795a30d1a6c1deea627/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:50:27.815743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe249c-4f94-405e-829f-2163996c4c02 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:27.815935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe249c-4f94-405e-829f-2163996c4c02 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:27.816219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe249c-4f94-405e-829f-2163996c4c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:27.844348 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-94fe249c-4f94-405e-829f-2163996c4c02 None None] MFA Rules not processed for user `f9a2e5d159ae4795a30d1a6c1deea627`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:27.845557 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-94fe249c-4f94-405e-829f-2163996c4c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:27.884483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:27.908932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1153/2319] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:27.920521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dcba9-dfeb-45f7-a915-53f6a26d4f1b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:27.922456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-913dcba9-dfeb-45f7-a915-53f6a26d4f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:27.997952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:28.000701 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913dcba9-dfeb-45f7-a915-53f6a26d4f1b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:28.005255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2d1ad-be81-4bd8-a397-75c93f9dd12f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0a8a5a1bc174acd9b13477c7d4b4a07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:28.005928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2d1ad-be81-4bd8-a397-75c93f9dd12f service glance] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:28.006192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2d1ad-be81-4bd8-a397-75c93f9dd12f service glance] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:28.006469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2d1ad-be81-4bd8-a397-75c93f9dd12f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:28.016434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2d1ad-be81-4bd8-a397-75c93f9dd12f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:28.016968 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2d1ad-be81-4bd8-a397-75c93f9dd12f service glance] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:28.026259 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1167/2320] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:50:31.003530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeac07f-4275-42bd-9eb5-11a906c3dfd8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:31.004703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeac07f-4275-42bd-9eb5-11a906c3dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:31.004703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeac07f-4275-42bd-9eb5-11a906c3dfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:31.024979 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ceeac07f-4275-42bd-9eb5-11a906c3dfd8 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:31.026174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ceeac07f-4275-42bd-9eb5-11a906c3dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:31.084778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1154/2321] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:31.122204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2d1ad-be81-4bd8-a397-75c93f9dd12f service glance] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:31.123648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eba2d1ad-be81-4bd8-a397-75c93f9dd12f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:31.197523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2d1ad-be81-4bd8-a397-75c93f9dd12f service glance] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:31.203154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a282b-d6af-4ea0-b0c1-0f234f663fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:31.203805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a282b-d6af-4ea0-b0c1-0f234f663fac service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:31.204092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a282b-d6af-4ea0-b0c1-0f234f663fac service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:31.204369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a282b-d6af-4ea0-b0c1-0f234f663fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:31.213374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a282b-d6af-4ea0-b0c1-0f234f663fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:31.215010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a282b-d6af-4ea0-b0c1-0f234f663fac service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:31.225327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1168/2322] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:50:35.271581 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3583-db38-41df-a36f-2ebdcfdc0c76 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:35.272150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3583-db38-41df-a36f-2ebdcfdc0c76 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:35.272150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b3583-db38-41df-a36f-2ebdcfdc0c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:35.291332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-775b3583-db38-41df-a36f-2ebdcfdc0c76 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:35.292537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-775b3583-db38-41df-a36f-2ebdcfdc0c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:35.305990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1155/2323] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 09:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:35.330133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a282b-d6af-4ea0-b0c1-0f234f663fac service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:35.331899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-703a282b-d6af-4ea0-b0c1-0f234f663fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:35.347563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a282b-d6af-4ea0-b0c1-0f234f663fac service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:35.353735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79ea3a-84c0-40d6-ad6d-f96b348ac0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:35.354415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79ea3a-84c0-40d6-ad6d-f96b348ac0d1 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:35.354702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79ea3a-84c0-40d6-ad6d-f96b348ac0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:35.355015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79ea3a-84c0-40d6-ad6d-f96b348ac0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:35.363920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79ea3a-84c0-40d6-ad6d-f96b348ac0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:35.365826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79ea3a-84c0-40d6-ad6d-f96b348ac0d1 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:35.375352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1169/2324] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:50:45.285058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=39 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:45.371143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=44 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:46.815819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691f06-8de1-4f69-ae4f-260ebc3f3a5a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:46.816305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691f06-8de1-4f69-ae4f-260ebc3f3a5a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:46.816401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd691f06-8de1-4f69-ae4f-260ebc3f3a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:46.835319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-dd691f06-8de1-4f69-ae4f-260ebc3f3a5a None None] MFA Rules not processed for user `38331c36830a426cbc41b370c707e44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:46.836519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-dd691f06-8de1-4f69-ae4f-260ebc3f3a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:46.890805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1156/2325] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:56.882894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=25 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:50:57.484786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79ea3a-84c0-40d6-ad6d-f96b348ac0d1 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:57.494429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79ea3a-84c0-40d6-ad6d-f96b348ac0d1 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:57.500396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:57.501270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:57.501555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:57.501826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] PATH_INFO: `/v3/users/f9a2e5d159ae4795a30d1a6c1deea627` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:57.503045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a2e5d159ae4795a30d1a6c1deea627)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:57.504957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:57.696750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a2e5d159ae4795a30d1a6c1deea627'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:57.709123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a2e5d159ae4795a30d1a6c1deea627'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:57.762208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a2e5d159ae4795a30d1a6c1deea627'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:57.762759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a2e5d159ae4795a30d1a6c1deea627'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:57.770874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a2e5d159ae4795a30d1a6c1deea627'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:57.777456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1170/2326] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:50:57 2022] DELETE /identity/v3/users/f9a2e5d159ae4795a30d1a6c1deea627 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:50:57.781907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275f39-a895-4e31-afbc-4caec2ae2a13 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:57.782201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275f39-a895-4e31-afbc-4caec2ae2a13 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:57.782483 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b275f39-a895-4e31-afbc-4caec2ae2a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:57.800627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2b275f39-a895-4e31-afbc-4caec2ae2a13 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:50:57.801810 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2b275f39-a895-4e31-afbc-4caec2ae2a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:57.861725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1157/2327] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:50:57.871440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:57.872830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:57.930418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89aaa62-d3ec-4476-bfdd-316f6e0b8b5c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:57.934602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5386be9-7e09-4f47-81a2-fb1fe8221adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:57.935371 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5386be9-7e09-4f47-81a2-fb1fe8221adb service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:57.935719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5386be9-7e09-4f47-81a2-fb1fe8221adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:57.935993 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5386be9-7e09-4f47-81a2-fb1fe8221adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:57.945718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5386be9-7e09-4f47-81a2-fb1fe8221adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:57.947590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5386be9-7e09-4f47-81a2-fb1fe8221adb service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:57.958271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1171/2328] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:50:58.402519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b275f39-a895-4e31-afbc-4caec2ae2a13 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:50:58.403989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2b275f39-a895-4e31-afbc-4caec2ae2a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:50:58.417130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b275f39-a895-4e31-afbc-4caec2ae2a13 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:50:58.422402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:50:58.423529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:50:58.423819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:50:58.428781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] PATH_INFO: `/v3/projects/90fe1702cf3a4ae0aad4007e275435a9` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:50:58.428781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90fe1702cf3a4ae0aad4007e275435a9)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:50:58.428781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:50:58.592725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90fe1702cf3a4ae0aad4007e275435a9', 'request_id': 'req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:58.598495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90fe1702cf3a4ae0aad4007e275435a9', 'request_id': 'req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:58.687855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90fe1702cf3a4ae0aad4007e275435a9', 'request_id': 'req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:58.700711 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] The token cache is being invalidate because project 90fe1702cf3a4ae0aad4007e275435a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:50:58.701004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:58.701659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4f37e014-1a3e-45f2-94a0-865b4de6aeb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:50:58.703478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1158/2329] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:50:58 2022] DELETE /identity/v3/projects/90fe1702cf3a4ae0aad4007e275435a9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:51:01.561397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5386be9-7e09-4f47-81a2-fb1fe8221adb service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:01.562822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f5386be9-7e09-4f47-81a2-fb1fe8221adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:01.574666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5386be9-7e09-4f47-81a2-fb1fe8221adb service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:01.628895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:01.629462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:01.629746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:01.630023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:01.631843 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:01.661440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:01.723233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:01.724682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:01.736783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1172/2330] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:06.176196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ef960-994b-4e88-9468-aeb76e58d0f7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:06.176906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ef960-994b-4e88-9468-aeb76e58d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:06.176906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ef960-994b-4e88-9468-aeb76e58d0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:06.194967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-327ef960-994b-4e88-9468-aeb76e58d0f7 None None] MFA Rules not processed for user `4a762aa672f5465da0f7cbc67ea7af9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:51:06.196170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-327ef960-994b-4e88-9468-aeb76e58d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:06.250692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1159/2331] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:51:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:51:06.288509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:06.291528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:06.346245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb4bb8-05fc-4dd1-b4da-e4e335999085 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:06.349754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0a8a5a1bc174acd9b13477c7d4b4a07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:06.350414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:06.350704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:06.351022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:06.352785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:06.366694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:06.368209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:06.380026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1173/2332] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:13.979499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ef960-994b-4e88-9468-aeb76e58d0f7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:13.981528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-327ef960-994b-4e88-9468-aeb76e58d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:14.020211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:14.063156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ef960-994b-4e88-9468-aeb76e58d0f7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:14.068895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d55e00-f6d6-4bf6-bb53-1956143e0be0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:14.069604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d55e00-f6d6-4bf6-bb53-1956143e0be0 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:14.069889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d55e00-f6d6-4bf6-bb53-1956143e0be0 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:14.070171 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d55e00-f6d6-4bf6-bb53-1956143e0be0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:14.072125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a4d55e00-f6d6-4bf6-bb53-1956143e0be0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:14.084755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d55e00-f6d6-4bf6-bb53-1956143e0be0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:14.086302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d55e00-f6d6-4bf6-bb53-1956143e0be0 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:14.098705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1160/2333] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:14.116188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:14.118787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:14.191387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382d946-bc2b-4bb3-8e5e-ee5f7892573e service glance] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:14.197068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:14.197948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:14.198238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:14.198553 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] PATH_INFO: `/v3/users/e24f6665d95e48c7b694d19b0dd132e2` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:14.200742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24f6665d95e48c7b694d19b0dd132e2)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:14.202618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:14.381782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24f6665d95e48c7b694d19b0dd132e2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:14.393520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:14.395786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24f6665d95e48c7b694d19b0dd132e2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:14.458443 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24f6665d95e48c7b694d19b0dd132e2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:14.459093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24f6665d95e48c7b694d19b0dd132e2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:14.466917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24f6665d95e48c7b694d19b0dd132e2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:14.473987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1174/2334] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:51:14 2022] DELETE /identity/v3/users/e24f6665d95e48c7b694d19b0dd132e2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:51:14.735955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d55e00-f6d6-4bf6-bb53-1956143e0be0 service placement] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:14.755610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d55e00-f6d6-4bf6-bb53-1956143e0be0 service placement] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:14.816196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:14.817324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:14.817718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:14.817957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] PATH_INFO: `/v3/projects/fde6f4c7aa2b4cc8ad441470dc722ed9` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:14.819158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] RBAC: Authorizing `identity:delete_project(project_id=fde6f4c7aa2b4cc8ad441470dc722ed9)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:14.821082 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:14.968292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fde6f4c7aa2b4cc8ad441470dc722ed9', 'request_id': 'req-89f4477e-6836-4a0a-8c25-166aafff25da'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:14.974296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fde6f4c7aa2b4cc8ad441470dc722ed9', 'request_id': 'req-89f4477e-6836-4a0a-8c25-166aafff25da'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:15.065086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fde6f4c7aa2b4cc8ad441470dc722ed9', 'request_id': 'req-89f4477e-6836-4a0a-8c25-166aafff25da'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:15.077164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] The token cache is being invalidate because project fde6f4c7aa2b4cc8ad441470dc722ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:51:15.077456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:15.078107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:15.079728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1161/2335] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:51:14 2022] DELETE /identity/v3/projects/fde6f4c7aa2b4cc8ad441470dc722ed9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:51:16.396179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:16.397680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:16.463659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c408f-815d-4659-a06d-af87ec282e4e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:16.519704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb1045-fef6-4bda-a03a-156da1e67254 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:16.520355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb1045-fef6-4bda-a03a-156da1e67254 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:16.520642 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb1045-fef6-4bda-a03a-156da1e67254 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:16.520921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb1045-fef6-4bda-a03a-156da1e67254 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:16.522688 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ddeb1045-fef6-4bda-a03a-156da1e67254 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:16.580781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb1045-fef6-4bda-a03a-156da1e67254 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:16.582140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb1045-fef6-4bda-a03a-156da1e67254 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:16.592168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1175/2336] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:17.508065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:17.509916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:17.566709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:17.592956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4477e-6836-4a0a-8c25-166aafff25da admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:17.598465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:17.599143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:17.599432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:17.599715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:17.601477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:17.660596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:17.662222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:17.673156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1162/2337] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:22.518449 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb1045-fef6-4bda-a03a-156da1e67254 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:22.532052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb1045-fef6-4bda-a03a-156da1e67254 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:22.537697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438e4ac-fcaf-4254-b1cd-e99230a8d374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:22.538365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438e4ac-fcaf-4254-b1cd-e99230a8d374 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:22.538648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438e4ac-fcaf-4254-b1cd-e99230a8d374 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:22.538952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438e4ac-fcaf-4254-b1cd-e99230a8d374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:22.540905 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c438e4ac-fcaf-4254-b1cd-e99230a8d374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:22.594579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:22.607885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438e4ac-fcaf-4254-b1cd-e99230a8d374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:22.609754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438e4ac-fcaf-4254-b1cd-e99230a8d374 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:22.620631 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1176/2338] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:25.643027 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:25.644639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:25.721251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d086d-a41c-4e42-97bd-6b2c4ab12a90 service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:25.725175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcdce3-4f43-4429-8c41-d0ead5a875d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:25.725966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcdce3-4f43-4429-8c41-d0ead5a875d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:25.726361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcdce3-4f43-4429-8c41-d0ead5a875d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:25.726535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcdce3-4f43-4429-8c41-d0ead5a875d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:25.728344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e0dcdce3-4f43-4429-8c41-d0ead5a875d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:25.739202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcdce3-4f43-4429-8c41-d0ead5a875d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:25.740656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcdce3-4f43-4429-8c41-d0ead5a875d9 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:25.750891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1163/2339] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:31.712305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe25d4-75a0-4195-b4c0-7372e4c387b2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:31.712879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe25d4-75a0-4195-b4c0-7372e4c387b2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:31.712879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe25d4-75a0-4195-b4c0-7372e4c387b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:31.732277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-febe25d4-75a0-4195-b4c0-7372e4c387b2 None None] MFA Rules not processed for user `cbb22c3df9e9452db19974f52d3ebb17`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:51:31.733706 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-febe25d4-75a0-4195-b4c0-7372e4c387b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:31.740947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1177/2340] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:51:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:51:32.047376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcdce3-4f43-4429-8c41-d0ead5a875d9 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:32.056370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcdce3-4f43-4429-8c41-d0ead5a875d9 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:32.060344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b544f-c183-4485-a872-e5081fc81594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:32.061004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b544f-c183-4485-a872-e5081fc81594 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:32.061286 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b544f-c183-4485-a872-e5081fc81594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:32.062202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b544f-c183-4485-a872-e5081fc81594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:32.063963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-659b544f-c183-4485-a872-e5081fc81594 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:32.073624 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b544f-c183-4485-a872-e5081fc81594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:32.075133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b544f-c183-4485-a872-e5081fc81594 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:32.086421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1164/2341] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:32.507790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe25d4-75a0-4195-b4c0-7372e4c387b2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:32.509176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-febe25d4-75a0-4195-b4c0-7372e4c387b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:32.586196 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe25d4-75a0-4195-b4c0-7372e4c387b2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:32.591583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a509f-c1c2-4f7c-82e0-c7945281c5c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:32.592245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a509f-c1c2-4f7c-82e0-c7945281c5c7 service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:32.592530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a509f-c1c2-4f7c-82e0-c7945281c5c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:32.594467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a509f-c1c2-4f7c-82e0-c7945281c5c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:32.596925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-096a509f-c1c2-4f7c-82e0-c7945281c5c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:32.610215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a509f-c1c2-4f7c-82e0-c7945281c5c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:32.611863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a509f-c1c2-4f7c-82e0-c7945281c5c7 service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:32.622166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1178/2342] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:40.559647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b544f-c183-4485-a872-e5081fc81594 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:40.572828 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b544f-c183-4485-a872-e5081fc81594 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:40.578292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:40.578985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:40.579240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:40.579520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:40.581471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:40.641718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:40.643536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:40.652617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1165/2343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:42.617786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=41 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:45.963175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a509f-c1c2-4f7c-82e0-c7945281c5c7 service placement] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:45.972624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a509f-c1c2-4f7c-82e0-c7945281c5c7 service placement] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:45.976260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1b57a-dacf-4539-919d-25f744098d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:45.976898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1b57a-dacf-4539-919d-25f744098d46 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:45.977185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1b57a-dacf-4539-919d-25f744098d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:45.977470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1b57a-dacf-4539-919d-25f744098d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:45.979252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1bf1b57a-dacf-4539-919d-25f744098d46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:46.043512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1b57a-dacf-4539-919d-25f744098d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:46.044941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1b57a-dacf-4539-919d-25f744098d46 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:46.055689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1179/2344] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:47.302940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:47.304432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:47.319503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986020cf-1295-4165-86ca-28707f26a988 service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:47.325256 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:47.325923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:47.326226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:47.326494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:47.328308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:47.341466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:47.343142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:47.349398 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:47.355852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1166/2345] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:49.976502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1b57a-dacf-4539-919d-25f744098d46 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:49.988212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1b57a-dacf-4539-919d-25f744098d46 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:49.993410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e179c1-ac8b-4545-96e1-2e63db441c94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:49.994107 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e179c1-ac8b-4545-96e1-2e63db441c94 service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:49.994394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e179c1-ac8b-4545-96e1-2e63db441c94 service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:49.994674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e179c1-ac8b-4545-96e1-2e63db441c94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:49.996486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-54e179c1-ac8b-4545-96e1-2e63db441c94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:50.009072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e179c1-ac8b-4545-96e1-2e63db441c94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:50.010668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e179c1-ac8b-4545-96e1-2e63db441c94 service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:50.021632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1180/2346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:50.089986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:50.092103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:50.107862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b328acc-9daf-40eb-9da5-6316b5df2412 service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:50.113369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:50.114229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:50.114516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:50.114809 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] PATH_INFO: `/v3/users/2cdef290abf8487ab370969a5e5b76c5` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:50.117729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cdef290abf8487ab370969a5e5b76c5)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:50.117982 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:50.291345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cdef290abf8487ab370969a5e5b76c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.292180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cdef290abf8487ab370969a5e5b76c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.307893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cdef290abf8487ab370969a5e5b76c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.317649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cdef290abf8487ab370969a5e5b76c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.389563 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-19b4d77a-62a9-488a-bc00-d963970078eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cdef290abf8487ab370969a5e5b76c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.397567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1167/2347] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:51:50 2022] DELETE /identity/v3/users/2cdef290abf8487ab370969a5e5b76c5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:51:50.649374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e179c1-ac8b-4545-96e1-2e63db441c94 service placement] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:50.662811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e179c1-ac8b-4545-96e1-2e63db441c94 service placement] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:50.723020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:50.723891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:50.724175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:50.724452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] PATH_INFO: `/v3/projects/afce7b92558e4afc9805f7b1ee69c862` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:50.725636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=afce7b92558e4afc9805f7b1ee69c862)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:50.731847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:50.853004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afce7b92558e4afc9805f7b1ee69c862', 'request_id': 'req-2c83edac-d425-4446-add8-825c0fad9d6a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.926591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afce7b92558e4afc9805f7b1ee69c862', 'request_id': 'req-2c83edac-d425-4446-add8-825c0fad9d6a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.932683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afce7b92558e4afc9805f7b1ee69c862', 'request_id': 'req-2c83edac-d425-4446-add8-825c0fad9d6a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.944972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] The token cache is being invalidate because project afce7b92558e4afc9805f7b1ee69c862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:51:50.945256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.945897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c83edac-d425-4446-add8-825c0fad9d6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:50.947808 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1181/2348] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:51:50 2022] DELETE /identity/v3/projects/afce7b92558e4afc9805f7b1ee69c862 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:51:50.952459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850826e-af3f-4905-8aa7-79771e6faa9d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:50.952751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850826e-af3f-4905-8aa7-79771e6faa9d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:50.953032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850826e-af3f-4905-8aa7-79771e6faa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:50.972314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a850826e-af3f-4905-8aa7-79771e6faa9d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:51:50.973534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a850826e-af3f-4905-8aa7-79771e6faa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:51.036272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1168/2349] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:51:51.044041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5da22-dbf7-411c-b6e3-e5e95bdb6d9b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.044547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5da22-dbf7-411c-b6e3-e5e95bdb6d9b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.044739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5da22-dbf7-411c-b6e3-e5e95bdb6d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.063287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b0e5da22-dbf7-411c-b6e3-e5e95bdb6d9b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:51:51.064611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b0e5da22-dbf7-411c-b6e3-e5e95bdb6d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:51.073275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1182/2350] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:51:51.077318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850826e-af3f-4905-8aa7-79771e6faa9d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:51.088231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850826e-af3f-4905-8aa7-79771e6faa9d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:51.092919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f3a09-e44b-4242-8f0c-ee739dcf456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:51.093499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f3a09-e44b-4242-8f0c-ee739dcf456f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.093786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f3a09-e44b-4242-8f0c-ee739dcf456f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.094061 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f3a09-e44b-4242-8f0c-ee739dcf456f admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.094992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f3a09-e44b-4242-8f0c-ee739dcf456f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:51:51.095308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f3a09-e44b-4242-8f0c-ee739dcf456f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:51.098261 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f3a09-e44b-4242-8f0c-ee739dcf456f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:51.115254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1169/2351] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:51:51.117132 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5da22-dbf7-411c-b6e3-e5e95bdb6d9b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:51.123181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:51.127026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5da22-dbf7-411c-b6e3-e5e95bdb6d9b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:51.131876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caecfe-b28d-48f6-94d7-58e6012e4008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:51.132537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caecfe-b28d-48f6-94d7-58e6012e4008 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.132824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caecfe-b28d-48f6-94d7-58e6012e4008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.133102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caecfe-b28d-48f6-94d7-58e6012e4008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.133801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caecfe-b28d-48f6-94d7-58e6012e4008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:51.135757 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caecfe-b28d-48f6-94d7-58e6012e4008 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:51.231203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1183/2352] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:51:51 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:51:51.235484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f3a09-e44b-4242-8f0c-ee739dcf456f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:51.246306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f3a09-e44b-4242-8f0c-ee739dcf456f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:51.305107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dba79-7c26-4efd-81fe-e82b2133039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:51.305904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dba79-7c26-4efd-81fe-e82b2133039e admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.306190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dba79-7c26-4efd-81fe-e82b2133039e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.306467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dba79-7c26-4efd-81fe-e82b2133039e admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.307199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dba79-7c26-4efd-81fe-e82b2133039e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:51.309200 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dba79-7c26-4efd-81fe-e82b2133039e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:51.316077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:51.378428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caecfe-b28d-48f6-94d7-58e6012e4008 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:51.380341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-94caecfe-b28d-48f6-94d7-58e6012e4008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:51.430343 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1170/2353] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:51:51 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:51:51.434253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dba79-7c26-4efd-81fe-e82b2133039e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:51.445939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dba79-7c26-4efd-81fe-e82b2133039e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:51.452599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3cbee-73c2-41df-af9c-74e748f2b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:51.453633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3cbee-73c2-41df-af9c-74e748f2b2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.454124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3cbee-73c2-41df-af9c-74e748f2b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.454704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3cbee-73c2-41df-af9c-74e748f2b2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.456142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3cbee-73c2-41df-af9c-74e748f2b2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:51.458207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3cbee-73c2-41df-af9c-74e748f2b2b0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:51.465859 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caecfe-b28d-48f6-94d7-58e6012e4008 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:51.474430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1171/2354] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:51:51.474571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0162d0-794d-44d2-90f0-7fd21751ca77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:51.475228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0162d0-794d-44d2-90f0-7fd21751ca77 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.475585 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0162d0-794d-44d2-90f0-7fd21751ca77 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.476150 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0162d0-794d-44d2-90f0-7fd21751ca77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.477447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3cbee-73c2-41df-af9c-74e748f2b2b0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:51.477964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4e0162d0-794d-44d2-90f0-7fd21751ca77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:51.487679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3cbee-73c2-41df-af9c-74e748f2b2b0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:51.493709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66bf3-7c19-47f4-9d8a-7428f7e2aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:51.493918 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0162d0-794d-44d2-90f0-7fd21751ca77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:51.494591 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66bf3-7c19-47f4-9d8a-7428f7e2aa4c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.495007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66bf3-7c19-47f4-9d8a-7428f7e2aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.495388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66bf3-7c19-47f4-9d8a-7428f7e2aa4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.495587 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0162d0-794d-44d2-90f0-7fd21751ca77 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:51.496309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66bf3-7c19-47f4-9d8a-7428f7e2aa4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:51.498008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66bf3-7c19-47f4-9d8a-7428f7e2aa4c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:51.507109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1184/2355] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:51:51.510017 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1172/2356] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:51:51.514064 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0162d0-794d-44d2-90f0-7fd21751ca77 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:51.525645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0162d0-794d-44d2-90f0-7fd21751ca77 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:51.530286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3c88-a6b5-48ba-a5ee-94860261598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:51.531215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3c88-a6b5-48ba-a5ee-94860261598f admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.531541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3c88-a6b5-48ba-a5ee-94860261598f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.531762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3c88-a6b5-48ba-a5ee-94860261598f admin admin] PATH_INFO: `/v3/projects/b75a7ac1f29749e3acd965d0bc14c19a/users/903f3d55e07c44ebba2564040275ab34/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.551244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d3c88-a6b5-48ba-a5ee-94860261598f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75a7ac1f29749e3acd965d0bc14c19a, user_id=903f3d55e07c44ebba2564040275ab34, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:51.553908 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d3c88-a6b5-48ba-a5ee-94860261598f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:51.617534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1185/2357] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:51:51 2022] PUT /identity/v3/projects/b75a7ac1f29749e3acd965d0bc14c19a/users/903f3d55e07c44ebba2564040275ab34/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:51:51.634328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f510-dbe1-4f31-b83b-0b8e02b34ce5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.634837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f510-dbe1-4f31-b83b-0b8e02b34ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.635300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f510-dbe1-4f31-b83b-0b8e02b34ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.667234 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8359f510-dbe1-4f31-b83b-0b8e02b34ce5 None None] MFA Rules not processed for user `903f3d55e07c44ebba2564040275ab34`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:51:51.668793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8359f510-dbe1-4f31-b83b-0b8e02b34ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:51.762125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1173/2358] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:51:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:51:51.775626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3c88-a6b5-48ba-a5ee-94860261598f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:51.859083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3c88-a6b5-48ba-a5ee-94860261598f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:51.866328 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77151d3f-8ba3-48a4-b7a7-2dfb86f2709e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:51.867029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77151d3f-8ba3-48a4-b7a7-2dfb86f2709e service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:51.867314 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77151d3f-8ba3-48a4-b7a7-2dfb86f2709e service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:51.867592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77151d3f-8ba3-48a4-b7a7-2dfb86f2709e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:51.876163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77151d3f-8ba3-48a4-b7a7-2dfb86f2709e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:51.878964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77151d3f-8ba3-48a4-b7a7-2dfb86f2709e service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:51.888765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1186/2359] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:57.685814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea46d4b-9c06-4259-acd4-381f9911ec06 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:57.686309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea46d4b-9c06-4259-acd4-381f9911ec06 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:57.686541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea46d4b-9c06-4259-acd4-381f9911ec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:57.712014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7ea46d4b-9c06-4259-acd4-381f9911ec06 None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:51:57.713313 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7ea46d4b-9c06-4259-acd4-381f9911ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:57.784889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1174/2360] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:51:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:51:57.845606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77151d3f-8ba3-48a4-b7a7-2dfb86f2709e service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:57.874793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:57.906827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77151d3f-8ba3-48a4-b7a7-2dfb86f2709e service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:57.912084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:57.913104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:57.913415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:57.913696 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] PATH_INFO: `/v3/users/903f3d55e07c44ebba2564040275ab34` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:57.914921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903f3d55e07c44ebba2564040275ab34)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:57.916852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:57.982801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea46d4b-9c06-4259-acd4-381f9911ec06 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:57.984217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7ea46d4b-9c06-4259-acd4-381f9911ec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:58.049567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:58.054342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea46d4b-9c06-4259-acd4-381f9911ec06 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:58.059434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056b46c-4a08-4ae6-ae40-bebfac5e1b98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:58.060099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b46c-4a08-4ae6-ae40-bebfac5e1b98 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:58.060381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b46c-4a08-4ae6-ae40-bebfac5e1b98 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:58.060656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b46c-4a08-4ae6-ae40-bebfac5e1b98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:58.070032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056b46c-4a08-4ae6-ae40-bebfac5e1b98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:58.071713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056b46c-4a08-4ae6-ae40-bebfac5e1b98 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:58.080123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1175/2361] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:51:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:51:58.138782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903f3d55e07c44ebba2564040275ab34'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:58.153735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903f3d55e07c44ebba2564040275ab34'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:58.257520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903f3d55e07c44ebba2564040275ab34'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:58.258319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903f3d55e07c44ebba2564040275ab34'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:58.266998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903f3d55e07c44ebba2564040275ab34'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:58.277578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1187/2362] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:51:57 2022] DELETE /identity/v3/users/903f3d55e07c44ebba2564040275ab34 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:51:58.282206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552aa91-4784-4059-b12b-d058ba526ea2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:58.282494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552aa91-4784-4059-b12b-d058ba526ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:58.283197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552aa91-4784-4059-b12b-d058ba526ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:58.306296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2552aa91-4784-4059-b12b-d058ba526ea2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:51:58.307453 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2552aa91-4784-4059-b12b-d058ba526ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:58.387786 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1176/2363] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:51:58.406804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:58.408950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:58.488252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152f32f-62d1-45cd-995a-fbf62b71f2f8 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:58.494807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f34ee-8a5c-440b-aab3-9f747165ad5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:58.496346 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f34ee-8a5c-440b-aab3-9f747165ad5e service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:58.497040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f34ee-8a5c-440b-aab3-9f747165ad5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:58.497440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f34ee-8a5c-440b-aab3-9f747165ad5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:58.512617 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f34ee-8a5c-440b-aab3-9f747165ad5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:58.514198 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f34ee-8a5c-440b-aab3-9f747165ad5e service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:58.538956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1188/2364] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:51:59.135855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552aa91-4784-4059-b12b-d058ba526ea2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:59.136576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2552aa91-4784-4059-b12b-d058ba526ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:59.166938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552aa91-4784-4059-b12b-d058ba526ea2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:59.170473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:59.171609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:59.171965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:59.172344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] PATH_INFO: `/v3/projects/b75a7ac1f29749e3acd965d0bc14c19a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:59.173631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75a7ac1f29749e3acd965d0bc14c19a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:59.175950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:59.292388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75a7ac1f29749e3acd965d0bc14c19a', 'request_id': 'req-34afaff8-b692-406b-99fe-387f0b13bcc2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:59.304803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75a7ac1f29749e3acd965d0bc14c19a', 'request_id': 'req-34afaff8-b692-406b-99fe-387f0b13bcc2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:59.357656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75a7ac1f29749e3acd965d0bc14c19a', 'request_id': 'req-34afaff8-b692-406b-99fe-387f0b13bcc2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:59.391556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] The token cache is being invalidate because project b75a7ac1f29749e3acd965d0bc14c19a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:51:59.391921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:59.392841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-34afaff8-b692-406b-99fe-387f0b13bcc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:51:59.401477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1177/2365] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:51:59 2022] DELETE /identity/v3/projects/b75a7ac1f29749e3acd965d0bc14c19a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:51:59.402076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79283a27-fcd6-4e01-b519-dc7be6371aa2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:59.402524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79283a27-fcd6-4e01-b519-dc7be6371aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:59.402780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79283a27-fcd6-4e01-b519-dc7be6371aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:59.424621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-79283a27-fcd6-4e01-b519-dc7be6371aa2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:51:59.429733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-79283a27-fcd6-4e01-b519-dc7be6371aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:59.498406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:51:59.521836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1189/2366] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:51:59.530716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab36f88-8475-4c0e-a772-c7d8c90799d4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:59.531175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab36f88-8475-4c0e-a772-c7d8c90799d4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:59.531539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab36f88-8475-4c0e-a772-c7d8c90799d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:59.554374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8ab36f88-8475-4c0e-a772-c7d8c90799d4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:51:59.555755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8ab36f88-8475-4c0e-a772-c7d8c90799d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:51:59.569868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1178/2367] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:51:59.574285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79283a27-fcd6-4e01-b519-dc7be6371aa2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:59.585250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79283a27-fcd6-4e01-b519-dc7be6371aa2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:59.596181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058b423-02e9-48d0-b608-4e11e2e69a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:59.596901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058b423-02e9-48d0-b608-4e11e2e69a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:59.598506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058b423-02e9-48d0-b608-4e11e2e69a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:59.598888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058b423-02e9-48d0-b608-4e11e2e69a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:59.599766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058b423-02e9-48d0-b608-4e11e2e69a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:51:59.600129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058b423-02e9-48d0-b608-4e11e2e69a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:59.601852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058b423-02e9-48d0-b608-4e11e2e69a52 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:59.617466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1190/2368] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:51:59.621513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab36f88-8475-4c0e-a772-c7d8c90799d4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:59.632225 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab36f88-8475-4c0e-a772-c7d8c90799d4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:59.639414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089786b-c9ef-4d28-8736-ab870efa1418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:59.640374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089786b-c9ef-4d28-8736-ab870efa1418 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:59.640661 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089786b-c9ef-4d28-8736-ab870efa1418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:59.640938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089786b-c9ef-4d28-8736-ab870efa1418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:59.641649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089786b-c9ef-4d28-8736-ab870efa1418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:59.643888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089786b-c9ef-4d28-8736-ab870efa1418 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:59.734896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1179/2369] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:51:59 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:51:59.737345 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058b423-02e9-48d0-b608-4e11e2e69a52 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:59.748643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058b423-02e9-48d0-b608-4e11e2e69a52 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:59.827681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d344f6-ea69-427c-87ba-a728289c3d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:59.828513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d344f6-ea69-427c-87ba-a728289c3d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:59.828876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d344f6-ea69-427c-87ba-a728289c3d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:59.829192 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d344f6-ea69-427c-87ba-a728289c3d17 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:59.830252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d344f6-ea69-427c-87ba-a728289c3d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:59.832709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d344f6-ea69-427c-87ba-a728289c3d17 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:59.916788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1191/2370] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:51:59 2022] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:51:59.921206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089786b-c9ef-4d28-8736-ab870efa1418 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:59.934163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089786b-c9ef-4d28-8736-ab870efa1418 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:59.938717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4eaa0-c37a-467f-a56f-f3e3af7a65d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:59.939419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4eaa0-c37a-467f-a56f-f3e3af7a65d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:59.939699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4eaa0-c37a-467f-a56f-f3e3af7a65d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:59.939977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4eaa0-c37a-467f-a56f-f3e3af7a65d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:59.940707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4eaa0-c37a-467f-a56f-f3e3af7a65d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:59.942302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4eaa0-c37a-467f-a56f-f3e3af7a65d9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:59.957501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1180/2371] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:51:59.959950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d344f6-ea69-427c-87ba-a728289c3d17 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:51:59.970869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d344f6-ea69-427c-87ba-a728289c3d17 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:51:59.975781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2168e4-8276-495f-bfc4-ee4d808634ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:51:59.976474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2168e4-8276-495f-bfc4-ee4d808634ec admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:51:59.976757 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2168e4-8276-495f-bfc4-ee4d808634ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:51:59.977090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2168e4-8276-495f-bfc4-ee4d808634ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:51:59.977876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2168e4-8276-495f-bfc4-ee4d808634ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:51:59.979530 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2168e4-8276-495f-bfc4-ee4d808634ec admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:51:59.990876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1192/2372] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:51:59.994869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4eaa0-c37a-467f-a56f-f3e3af7a65d9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:00.012544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4eaa0-c37a-467f-a56f-f3e3af7a65d9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:00.019423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe208945-20d8-4be5-afb2-402e91640911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:00.020347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe208945-20d8-4be5-afb2-402e91640911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:00.020654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe208945-20d8-4be5-afb2-402e91640911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:00.021678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe208945-20d8-4be5-afb2-402e91640911 admin admin] PATH_INFO: `/v3/projects/1977400af1094fd880e3ebedd42307eb/users/2dc73e8b07ad412a859766e251fef252/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:00.040514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe208945-20d8-4be5-afb2-402e91640911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1977400af1094fd880e3ebedd42307eb, user_id=2dc73e8b07ad412a859766e251fef252, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:00.043407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe208945-20d8-4be5-afb2-402e91640911 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:00.100198 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1181/2373] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:51:59 2022] PUT /identity/v3/projects/1977400af1094fd880e3ebedd42307eb/users/2dc73e8b07ad412a859766e251fef252/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:00.111426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb973b94-745e-4cac-9377-fe1419655cf7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:00.112036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb973b94-745e-4cac-9377-fe1419655cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:00.112540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb973b94-745e-4cac-9377-fe1419655cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:00.151475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fb973b94-745e-4cac-9377-fe1419655cf7 None None] MFA Rules not processed for user `2dc73e8b07ad412a859766e251fef252`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:00.153047 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fb973b94-745e-4cac-9377-fe1419655cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:00.253315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1193/2374] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:00.253919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe208945-20d8-4be5-afb2-402e91640911 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:00.268844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:00.328909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe208945-20d8-4be5-afb2-402e91640911 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:00.337262 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f550-e52e-4975-8298-0c18563ca6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:00.337940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f550-e52e-4975-8298-0c18563ca6fb admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:00.338243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f550-e52e-4975-8298-0c18563ca6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:00.338513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7f550-e52e-4975-8298-0c18563ca6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:00.339253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7f550-e52e-4975-8298-0c18563ca6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:00.341194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7f550-e52e-4975-8298-0c18563ca6fb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:00.480827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb973b94-745e-4cac-9377-fe1419655cf7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:00.481604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1182/2375] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:00 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:00.494459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb973b94-745e-4cac-9377-fe1419655cf7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:00.582146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:00.602342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f5cd0-e0c4-40c7-802a-f33bf2bd4d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:00.603207 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f5cd0-e0c4-40c7-802a-f33bf2bd4d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:00.603638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f5cd0-e0c4-40c7-802a-f33bf2bd4d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:00.603928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f5cd0-e0c4-40c7-802a-f33bf2bd4d18 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:00.604649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f5cd0-e0c4-40c7-802a-f33bf2bd4d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:00.607235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f5cd0-e0c4-40c7-802a-f33bf2bd4d18 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:00.696305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f550-e52e-4975-8298-0c18563ca6fb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:00.696622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1194/2376] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:00 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:00.706825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7f550-e52e-4975-8298-0c18563ca6fb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:00.712980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45e42-90e4-4007-9531-0d5f4d22c02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:00.716811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45e42-90e4-4007-9531-0d5f4d22c02b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:00.716811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45e42-90e4-4007-9531-0d5f4d22c02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:00.716811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45e42-90e4-4007-9531-0d5f4d22c02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:00.716811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a45e42-90e4-4007-9531-0d5f4d22c02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:00.716811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a45e42-90e4-4007-9531-0d5f4d22c02b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:00.732914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1183/2377] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:00.737172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f5cd0-e0c4-40c7-802a-f33bf2bd4d18 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:00.748418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f5cd0-e0c4-40c7-802a-f33bf2bd4d18 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:00.753781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23342105-82c5-4aa7-aeb7-65749f263a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:00.756685 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23342105-82c5-4aa7-aeb7-65749f263a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:00.757032 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23342105-82c5-4aa7-aeb7-65749f263a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:00.757313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23342105-82c5-4aa7-aeb7-65749f263a34 admin admin] PATH_INFO: `/v3/projects/dfeee472a82d48658620a4b8c3927007/users/4425a4a90e1344899b6fb01a0878ec81/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:00.776845 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23342105-82c5-4aa7-aeb7-65749f263a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfeee472a82d48658620a4b8c3927007, user_id=4425a4a90e1344899b6fb01a0878ec81, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:00.779729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23342105-82c5-4aa7-aeb7-65749f263a34 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:00.850011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1195/2378] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:00 2022] PUT /identity/v3/projects/dfeee472a82d48658620a4b8c3927007/users/4425a4a90e1344899b6fb01a0878ec81/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:00.854140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45e42-90e4-4007-9531-0d5f4d22c02b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:00.867130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45e42-90e4-4007-9531-0d5f4d22c02b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:00.938493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e5b80-706d-40d2-bcff-ec8482d0b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:00.939290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5b80-706d-40d2-bcff-ec8482d0b692 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:00.939577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5b80-706d-40d2-bcff-ec8482d0b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:00.939857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e5b80-706d-40d2-bcff-ec8482d0b692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:00.940611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e5b80-706d-40d2-bcff-ec8482d0b692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:00.942319 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2e5b80-706d-40d2-bcff-ec8482d0b692 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:00.954600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1184/2379] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:52:00.959101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23342105-82c5-4aa7-aeb7-65749f263a34 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:00.970430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23342105-82c5-4aa7-aeb7-65749f263a34 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:00.975976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf4184-3fd2-4d70-be39-fa1f9db6909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:00.977220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf4184-3fd2-4d70-be39-fa1f9db6909b admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:00.977509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf4184-3fd2-4d70-be39-fa1f9db6909b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:00.977790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf4184-3fd2-4d70-be39-fa1f9db6909b admin admin] PATH_INFO: `/v3/projects/dfeee472a82d48658620a4b8c3927007/users/4425a4a90e1344899b6fb01a0878ec81/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:00.980024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf4184-3fd2-4d70-be39-fa1f9db6909b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfeee472a82d48658620a4b8c3927007, user_id=4425a4a90e1344899b6fb01a0878ec81, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:00.982885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baf4184-3fd2-4d70-be39-fa1f9db6909b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:00.996190 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1196/2380] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:00 2022] PUT /identity/v3/projects/dfeee472a82d48658620a4b8c3927007/users/4425a4a90e1344899b6fb01a0878ec81/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:01.007871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf3b4-e416-4382-a033-39e9a3c63cf1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:01.008162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf3b4-e416-4382-a033-39e9a3c63cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:01.008443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bf3b4-e416-4382-a033-39e9a3c63cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:01.038525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a12bf3b4-e416-4382-a033-39e9a3c63cf1 None None] MFA Rules not processed for user `4425a4a90e1344899b6fb01a0878ec81`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:01.040064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a12bf3b4-e416-4382-a033-39e9a3c63cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:01.124190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1185/2381] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:01.136182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf4184-3fd2-4d70-be39-fa1f9db6909b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:01.137842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3baf4184-3fd2-4d70-be39-fa1f9db6909b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:01.206516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baf4184-3fd2-4d70-be39-fa1f9db6909b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:01.212782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc2a8-7013-4f7f-a407-5fcecd6181ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:01.212782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc2a8-7013-4f7f-a407-5fcecd6181ed service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:01.212782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc2a8-7013-4f7f-a407-5fcecd6181ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:01.212782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc2a8-7013-4f7f-a407-5fcecd6181ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:01.220985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebc2a8-7013-4f7f-a407-5fcecd6181ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:01.222411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebc2a8-7013-4f7f-a407-5fcecd6181ed service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:01.232369 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1197/2382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:01.261320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf3b4-e416-4382-a033-39e9a3c63cf1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:01.270472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:01.330777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bf3b4-e416-4382-a033-39e9a3c63cf1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:01.337161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:01.338350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:01.339050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:01.339432 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] PATH_INFO: `/v3/users/2dc73e8b07ad412a859766e251fef252` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:01.340717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc73e8b07ad412a859766e251fef252)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:01.342685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:01.566690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc73e8b07ad412a859766e251fef252'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:01.567512 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc73e8b07ad412a859766e251fef252'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:01.582272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc73e8b07ad412a859766e251fef252'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:01.594000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc73e8b07ad412a859766e251fef252'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:01.660577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc73e8b07ad412a859766e251fef252'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:01.673491 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f86a33-f005-44da-8e19-99b4249d8eb1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:01.673999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f86a33-f005-44da-8e19-99b4249d8eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:01.674100 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f86a33-f005-44da-8e19-99b4249d8eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:01.677122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1186/2383] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:01 2022] DELETE /identity/v3/users/2dc73e8b07ad412a859766e251fef252 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:01.696037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a2f86a33-f005-44da-8e19-99b4249d8eb1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:01.697485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a2f86a33-f005-44da-8e19-99b4249d8eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:01.786075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1198/2384] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:01.796628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:01.798040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:01.892740 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dc3b2-c9a5-429d-8d22-2197483cfb76 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:01.896748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73703188-aab8-4995-9774-f9bcb81cb88f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:01.897516 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73703188-aab8-4995-9774-f9bcb81cb88f service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:01.897952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73703188-aab8-4995-9774-f9bcb81cb88f service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:01.898237 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73703188-aab8-4995-9774-f9bcb81cb88f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:01.910231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73703188-aab8-4995-9774-f9bcb81cb88f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:01.911746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73703188-aab8-4995-9774-f9bcb81cb88f service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:01.923078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1187/2385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:02.467141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f86a33-f005-44da-8e19-99b4249d8eb1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:02.469002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a2f86a33-f005-44da-8e19-99b4249d8eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:02.485404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f86a33-f005-44da-8e19-99b4249d8eb1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:02.498707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:02.500506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:02.501115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:02.501482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] PATH_INFO: `/v3/projects/1977400af1094fd880e3ebedd42307eb` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:02.504236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1977400af1094fd880e3ebedd42307eb)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:02.507122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:02.668654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:02.695891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1977400af1094fd880e3ebedd42307eb', 'request_id': 'req-0f33d08a-0892-42fc-bd34-731613790856'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:02.779090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1977400af1094fd880e3ebedd42307eb', 'request_id': 'req-0f33d08a-0892-42fc-bd34-731613790856'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:02.787308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1977400af1094fd880e3ebedd42307eb', 'request_id': 'req-0f33d08a-0892-42fc-bd34-731613790856'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:02.799496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] The token cache is being invalidate because project 1977400af1094fd880e3ebedd42307eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:02.799969 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:02.801231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:02.806407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1199/2386] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:02 2022] DELETE /identity/v3/projects/1977400af1094fd880e3ebedd42307eb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:02.807619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73703188-aab8-4995-9774-f9bcb81cb88f service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:02.820406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73703188-aab8-4995-9774-f9bcb81cb88f service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:02.852966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:02.887956 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:02.888889 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:02.889224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:02.889515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] PATH_INFO: `/v3/users/4425a4a90e1344899b6fb01a0878ec81` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:02.891037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4425a4a90e1344899b6fb01a0878ec81)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:02.893121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:03.105811 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4425a4a90e1344899b6fb01a0878ec81'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:03.106404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4425a4a90e1344899b6fb01a0878ec81'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:03.123093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4425a4a90e1344899b6fb01a0878ec81'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:03.143558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4425a4a90e1344899b6fb01a0878ec81'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:03.200773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-763559ee-315a-4db4-89de-a7314384f5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4425a4a90e1344899b6fb01a0878ec81'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:03.212611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1188/2387] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:02 2022] DELETE /identity/v3/users/4425a4a90e1344899b6fb01a0878ec81 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:03.726874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:03.728465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:03.756542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d08a-0892-42fc-bd34-731613790856 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:03.887509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:03.888733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:03.889243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:03.889753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] PATH_INFO: `/v3/projects/dfeee472a82d48658620a4b8c3927007` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:03.891538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfeee472a82d48658620a4b8c3927007)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:03.893706 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:04.054887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfeee472a82d48658620a4b8c3927007', 'request_id': 'req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:04.120514 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfeee472a82d48658620a4b8c3927007', 'request_id': 'req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:04.129347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfeee472a82d48658620a4b8c3927007', 'request_id': 'req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:04.164108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] The token cache is being invalidate because project dfeee472a82d48658620a4b8c3927007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:04.164401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:04.166252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3378d248-c7e4-42ff-aeb9-115aa5bc7b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:04.171668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1200/2388] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:03 2022] DELETE /identity/v3/projects/dfeee472a82d48658620a4b8c3927007 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:04.173266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513c68-bae8-4d8e-8a4b-303b80f7ab5a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:04.173758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513c68-bae8-4d8e-8a4b-303b80f7ab5a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:04.173952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df513c68-bae8-4d8e-8a4b-303b80f7ab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:04.196231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-df513c68-bae8-4d8e-8a4b-303b80f7ab5a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:04.197850 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-df513c68-bae8-4d8e-8a4b-303b80f7ab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:04.281093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1189/2389] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:04.293195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66647945-8f85-4810-b69c-5b472464feba None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:04.293570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66647945-8f85-4810-b69c-5b472464feba None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:04.293929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66647945-8f85-4810-b69c-5b472464feba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:04.316867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-66647945-8f85-4810-b69c-5b472464feba None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:04.318863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-66647945-8f85-4810-b69c-5b472464feba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:04.328402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1201/2390] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:04.334054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513c68-bae8-4d8e-8a4b-303b80f7ab5a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:04.346077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df513c68-bae8-4d8e-8a4b-303b80f7ab5a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:04.351315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147d812-79dc-4aec-a0a8-bd479431986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:04.352321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d812-79dc-4aec-a0a8-bd479431986f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:04.352321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d812-79dc-4aec-a0a8-bd479431986f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:04.352603 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147d812-79dc-4aec-a0a8-bd479431986f admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:04.353255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147d812-79dc-4aec-a0a8-bd479431986f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:04.353566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147d812-79dc-4aec-a0a8-bd479431986f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:04.355234 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147d812-79dc-4aec-a0a8-bd479431986f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:04.367390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1190/2391] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:04.371869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66647945-8f85-4810-b69c-5b472464feba None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:04.381934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66647945-8f85-4810-b69c-5b472464feba None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:04.386612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdec58-c472-45f2-923c-52177f120e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:04.387310 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdec58-c472-45f2-923c-52177f120e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:04.387601 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdec58-c472-45f2-923c-52177f120e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:04.387883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdec58-c472-45f2-923c-52177f120e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:04.388577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdec58-c472-45f2-923c-52177f120e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:04.390744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdec58-c472-45f2-923c-52177f120e80 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:04.600765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1202/2392] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:04 2022] POST /identity/v3/projects => generated 399 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:04.606206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147d812-79dc-4aec-a0a8-bd479431986f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:04.617029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147d812-79dc-4aec-a0a8-bd479431986f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:04.654904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:04.684559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c2d7f-8c1d-4f8c-935a-5a41b49e0f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:04.685241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c2d7f-8c1d-4f8c-935a-5a41b49e0f47 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:04.685526 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c2d7f-8c1d-4f8c-935a-5a41b49e0f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:04.685813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c2d7f-8c1d-4f8c-935a-5a41b49e0f47 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:04.686504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c2d7f-8c1d-4f8c-935a-5a41b49e0f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:04.688724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c2d7f-8c1d-4f8c-935a-5a41b49e0f47 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:04.805514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1191/2393] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:04 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:04.806624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdec58-c472-45f2-923c-52177f120e80 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:04.819701 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdec58-c472-45f2-923c-52177f120e80 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:04.827528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa5177-db80-4c54-b0b0-0c60cfbddd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:04.832540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa5177-db80-4c54-b0b0-0c60cfbddd74 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:04.832540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa5177-db80-4c54-b0b0-0c60cfbddd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:04.832540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa5177-db80-4c54-b0b0-0c60cfbddd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:04.832540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa5177-db80-4c54-b0b0-0c60cfbddd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:04.832540 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa5177-db80-4c54-b0b0-0c60cfbddd74 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:04.848115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1203/2394] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:04.852728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c2d7f-8c1d-4f8c-935a-5a41b49e0f47 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:04.863273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c2d7f-8c1d-4f8c-935a-5a41b49e0f47 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:04.871159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dc9b8-ccd4-4f8d-8037-137c2c943da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:04.871963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dc9b8-ccd4-4f8d-8037-137c2c943da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:04.872296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dc9b8-ccd4-4f8d-8037-137c2c943da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:04.872522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dc9b8-ccd4-4f8d-8037-137c2c943da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:04.873307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dc9b8-ccd4-4f8d-8037-137c2c943da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:04.874950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49dc9b8-ccd4-4f8d-8037-137c2c943da1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:04.887212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1192/2395] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:04.893457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa5177-db80-4c54-b0b0-0c60cfbddd74 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:04.905185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa5177-db80-4c54-b0b0-0c60cfbddd74 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:04.911804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a7fa9-cc05-455b-bb2c-82255242d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:04.913077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7fa9-cc05-455b-bb2c-82255242d549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:04.913427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7fa9-cc05-455b-bb2c-82255242d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:04.913776 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a7fa9-cc05-455b-bb2c-82255242d549 admin admin] PATH_INFO: `/v3/projects/dcfa84ad03bd46728fb1db1adb232598/users/6145e5b627d54b81b86dc49b269527ab/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:04.931556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:04.935126 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a7fa9-cc05-455b-bb2c-82255242d549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcfa84ad03bd46728fb1db1adb232598, user_id=6145e5b627d54b81b86dc49b269527ab, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:04.938297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a7fa9-cc05-455b-bb2c-82255242d549 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:05.007324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1204/2396] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:04 2022] PUT /identity/v3/projects/dcfa84ad03bd46728fb1db1adb232598/users/6145e5b627d54b81b86dc49b269527ab/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:05.019060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6238e2-bbb3-4ae9-9f9a-9f227f44f438 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:05.019254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6238e2-bbb3-4ae9-9f9a-9f227f44f438 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:05.019541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6238e2-bbb3-4ae9-9f9a-9f227f44f438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:05.051166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6f6238e2-bbb3-4ae9-9f9a-9f227f44f438 None None] MFA Rules not processed for user `6145e5b627d54b81b86dc49b269527ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:05.052576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6f6238e2-bbb3-4ae9-9f9a-9f227f44f438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:05.140041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1193/2397] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:05.144630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a7fa9-cc05-455b-bb2c-82255242d549 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:05.220836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a7fa9-cc05-455b-bb2c-82255242d549 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:05.225762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86430b8a-5448-48cf-8dd9-d2c6796a771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:05.226750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86430b8a-5448-48cf-8dd9-d2c6796a771b admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:05.227057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86430b8a-5448-48cf-8dd9-d2c6796a771b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:05.227341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86430b8a-5448-48cf-8dd9-d2c6796a771b admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:05.228053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86430b8a-5448-48cf-8dd9-d2c6796a771b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:05.230824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86430b8a-5448-48cf-8dd9-d2c6796a771b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:05.311998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1205/2398] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:05 2022] POST /identity/v3/projects => generated 401 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:05.316679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6238e2-bbb3-4ae9-9f9a-9f227f44f438 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:05.328720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6238e2-bbb3-4ae9-9f9a-9f227f44f438 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:05.414821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c27c1a-8b7d-4202-8d29-be8b045d8631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:05.415632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c27c1a-8b7d-4202-8d29-be8b045d8631 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:05.417110 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c27c1a-8b7d-4202-8d29-be8b045d8631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:05.418038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c27c1a-8b7d-4202-8d29-be8b045d8631 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:05.418164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c27c1a-8b7d-4202-8d29-be8b045d8631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:05.420271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c27c1a-8b7d-4202-8d29-be8b045d8631 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:05.493190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1194/2399] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:05 2022] POST /identity/v3/users => generated 307 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:05.497298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86430b8a-5448-48cf-8dd9-d2c6796a771b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:05.510833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86430b8a-5448-48cf-8dd9-d2c6796a771b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:05.516598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035fce2-474b-45ce-8d0f-99562baee11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:05.522996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035fce2-474b-45ce-8d0f-99562baee11a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:05.522996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035fce2-474b-45ce-8d0f-99562baee11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:05.522996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035fce2-474b-45ce-8d0f-99562baee11a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:05.522996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035fce2-474b-45ce-8d0f-99562baee11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:05.522996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035fce2-474b-45ce-8d0f-99562baee11a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:05.534974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1206/2400] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:05.538755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c27c1a-8b7d-4202-8d29-be8b045d8631 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:05.550987 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c27c1a-8b7d-4202-8d29-be8b045d8631 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:05.556815 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f225b9b-6b2a-4fdd-9392-f1c5f77fc158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:05.557989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f225b9b-6b2a-4fdd-9392-f1c5f77fc158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:05.558306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f225b9b-6b2a-4fdd-9392-f1c5f77fc158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:05.558555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f225b9b-6b2a-4fdd-9392-f1c5f77fc158 admin admin] PATH_INFO: `/v3/projects/1db06b7fe8fc41df94da29a669a69b49/users/0e1761569c33432393f9148269e5aca7/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:05.585077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f225b9b-6b2a-4fdd-9392-f1c5f77fc158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db06b7fe8fc41df94da29a669a69b49, user_id=0e1761569c33432393f9148269e5aca7, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:05.588042 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f225b9b-6b2a-4fdd-9392-f1c5f77fc158 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:05.675978 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1195/2401] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:05 2022] PUT /identity/v3/projects/1db06b7fe8fc41df94da29a669a69b49/users/0e1761569c33432393f9148269e5aca7/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:05.680619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035fce2-474b-45ce-8d0f-99562baee11a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:05.691639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035fce2-474b-45ce-8d0f-99562baee11a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:05.763131 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110772d-07f3-4090-af2f-da037ddd7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:05.764015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110772d-07f3-4090-af2f-da037ddd7ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:05.764398 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110772d-07f3-4090-af2f-da037ddd7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:05.764771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110772d-07f3-4090-af2f-da037ddd7ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:05.765849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110772d-07f3-4090-af2f-da037ddd7ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:05.767634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110772d-07f3-4090-af2f-da037ddd7ae1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:05.780067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1207/2402] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:05.784186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f225b9b-6b2a-4fdd-9392-f1c5f77fc158 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:05.796383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f225b9b-6b2a-4fdd-9392-f1c5f77fc158 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:05.801419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de97d8f-cfe9-4d98-9b76-ab7014bca990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:05.803421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de97d8f-cfe9-4d98-9b76-ab7014bca990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:05.803773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de97d8f-cfe9-4d98-9b76-ab7014bca990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:05.804139 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de97d8f-cfe9-4d98-9b76-ab7014bca990 admin admin] PATH_INFO: `/v3/projects/1db06b7fe8fc41df94da29a669a69b49/users/0e1761569c33432393f9148269e5aca7/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:05.806181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de97d8f-cfe9-4d98-9b76-ab7014bca990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db06b7fe8fc41df94da29a669a69b49, user_id=0e1761569c33432393f9148269e5aca7, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:05.809076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de97d8f-cfe9-4d98-9b76-ab7014bca990 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:05.814295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:05.821709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1196/2403] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:05 2022] PUT /identity/v3/projects/1db06b7fe8fc41df94da29a669a69b49/users/0e1761569c33432393f9148269e5aca7/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:05.831981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934abd9-13e5-4abd-84ed-0a23e1294cc3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:05.832479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934abd9-13e5-4abd-84ed-0a23e1294cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:05.832571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934abd9-13e5-4abd-84ed-0a23e1294cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:05.865093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c934abd9-13e5-4abd-84ed-0a23e1294cc3 None None] MFA Rules not processed for user `0e1761569c33432393f9148269e5aca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:05.866713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c934abd9-13e5-4abd-84ed-0a23e1294cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:05.940780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:05.969221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1208/2404] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:05 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:05.981961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de97d8f-cfe9-4d98-9b76-ab7014bca990 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:05.983994 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4de97d8f-cfe9-4d98-9b76-ab7014bca990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:06.060377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de97d8f-cfe9-4d98-9b76-ab7014bca990 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:06.064981 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b02b8-4873-47cd-a65e-2d784f2a271c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:06.065715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b02b8-4873-47cd-a65e-2d784f2a271c service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:06.066072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b02b8-4873-47cd-a65e-2d784f2a271c service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:06.066440 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b02b8-4873-47cd-a65e-2d784f2a271c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:06.081102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b02b8-4873-47cd-a65e-2d784f2a271c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:06.082573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b02b8-4873-47cd-a65e-2d784f2a271c service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:06.095361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1197/2405] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:05 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:06.407059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934abd9-13e5-4abd-84ed-0a23e1294cc3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:06.411213 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c934abd9-13e5-4abd-84ed-0a23e1294cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:06.436940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934abd9-13e5-4abd-84ed-0a23e1294cc3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:06.441260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a687dc4-569a-478d-94a8-5eb10487548d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:06.443620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687dc4-569a-478d-94a8-5eb10487548d service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:06.445438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687dc4-569a-478d-94a8-5eb10487548d service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:06.445438 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687dc4-569a-478d-94a8-5eb10487548d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:06.531856 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687dc4-569a-478d-94a8-5eb10487548d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:06.533388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a687dc4-569a-478d-94a8-5eb10487548d service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:06.545048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1209/2406] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:11.780729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b02b8-4873-47cd-a65e-2d784f2a271c service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:11.846513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b02b8-4873-47cd-a65e-2d784f2a271c service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:11.851525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:11.852409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:11.852685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:11.852960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] PATH_INFO: `/v3/users/6145e5b627d54b81b86dc49b269527ab` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:11.854204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6145e5b627d54b81b86dc49b269527ab)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:11.856170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:12.010308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6145e5b627d54b81b86dc49b269527ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.011108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6145e5b627d54b81b86dc49b269527ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.023778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6145e5b627d54b81b86dc49b269527ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.030729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6145e5b627d54b81b86dc49b269527ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.080282 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6145e5b627d54b81b86dc49b269527ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.086415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1198/2407] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:11 2022] DELETE /identity/v3/users/6145e5b627d54b81b86dc49b269527ab => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:12.090863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8646a-15da-4e43-8019-f8285418a3f2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:12.091407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8646a-15da-4e43-8019-f8285418a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:12.091524 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8646a-15da-4e43-8019-f8285418a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:12.117759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e8b8646a-15da-4e43-8019-f8285418a3f2 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:12.117759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e8b8646a-15da-4e43-8019-f8285418a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:12.171378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1210/2408] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:12.181047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:12.182471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:12.203444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:12.240600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd720a9f-f822-457a-9875-1f13a372a351 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:12.244233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4c13b-5075-4dc7-bfb7-60bc338430d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:12.244868 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4c13b-5075-4dc7-bfb7-60bc338430d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:12.245182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4c13b-5075-4dc7-bfb7-60bc338430d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:12.245498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4c13b-5075-4dc7-bfb7-60bc338430d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:12.255232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4c13b-5075-4dc7-bfb7-60bc338430d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:12.256758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4c13b-5075-4dc7-bfb7-60bc338430d8 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:12.266826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1199/2409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:12.710762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8646a-15da-4e43-8019-f8285418a3f2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:12.714400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e8b8646a-15da-4e43-8019-f8285418a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:12.724174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8646a-15da-4e43-8019-f8285418a3f2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:12.729494 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:12.730373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:12.730980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:12.731376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] PATH_INFO: `/v3/projects/dcfa84ad03bd46728fb1db1adb232598` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:12.732579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcfa84ad03bd46728fb1db1adb232598)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:12.734521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:12.853533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcfa84ad03bd46728fb1db1adb232598', 'request_id': 'req-fd524532-af59-4b2e-b70b-1b03ee1f9c20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.903516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcfa84ad03bd46728fb1db1adb232598', 'request_id': 'req-fd524532-af59-4b2e-b70b-1b03ee1f9c20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.909649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcfa84ad03bd46728fb1db1adb232598', 'request_id': 'req-fd524532-af59-4b2e-b70b-1b03ee1f9c20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.922109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] The token cache is being invalidate because project dcfa84ad03bd46728fb1db1adb232598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:12.922407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.923089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:12.924678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1211/2410] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:12 2022] DELETE /identity/v3/projects/dcfa84ad03bd46728fb1db1adb232598 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:12.929074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4c13b-5075-4dc7-bfb7-60bc338430d8 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:12.939838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4c13b-5075-4dc7-bfb7-60bc338430d8 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:12.998812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:12.999746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:13.001005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:13.001005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] PATH_INFO: `/v3/users/0e1761569c33432393f9148269e5aca7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:13.001534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1761569c33432393f9148269e5aca7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:13.003623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:13.166717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1761569c33432393f9148269e5aca7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:13.167156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1761569c33432393f9148269e5aca7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:13.180697 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1761569c33432393f9148269e5aca7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:13.188077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1761569c33432393f9148269e5aca7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:13.271194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-02863f6c-937d-4297-8552-4926d9277201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1761569c33432393f9148269e5aca7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:13.278433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1200/2411] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:12 2022] DELETE /identity/v3/users/0e1761569c33432393f9148269e5aca7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:13.785982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:13.788951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:13.802296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd524532-af59-4b2e-b70b-1b03ee1f9c20 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:13.810626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:13.871261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:13.872177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:13.872464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:13.872745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] PATH_INFO: `/v3/projects/1db06b7fe8fc41df94da29a669a69b49` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:13.873951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db06b7fe8fc41df94da29a669a69b49)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:13.876080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:13.970025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db06b7fe8fc41df94da29a669a69b49', 'request_id': 'req-484daeea-48ab-4ebb-a308-daa3b3695402'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:14.040218 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db06b7fe8fc41df94da29a669a69b49', 'request_id': 'req-484daeea-48ab-4ebb-a308-daa3b3695402'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:14.047694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db06b7fe8fc41df94da29a669a69b49', 'request_id': 'req-484daeea-48ab-4ebb-a308-daa3b3695402'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:14.059044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] The token cache is being invalidate because project 1db06b7fe8fc41df94da29a669a69b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:14.059329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:14.059988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-484daeea-48ab-4ebb-a308-daa3b3695402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:14.061558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1212/2412] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:13 2022] DELETE /identity/v3/projects/1db06b7fe8fc41df94da29a669a69b49 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:14.066445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dac79-2e9d-4821-ab9b-6ede4e522935 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.066962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dac79-2e9d-4821-ab9b-6ede4e522935 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.067370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dac79-2e9d-4821-ab9b-6ede4e522935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.089133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-951dac79-2e9d-4821-ab9b-6ede4e522935 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:14.090412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-951dac79-2e9d-4821-ab9b-6ede4e522935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:14.128332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:14.156471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1201/2413] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:14.164747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c1f5-7d03-4b31-b99a-369deb844c8a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.165150 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c1f5-7d03-4b31-b99a-369deb844c8a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.165498 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c1f5-7d03-4b31-b99a-369deb844c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.185324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4e43c1f5-7d03-4b31-b99a-369deb844c8a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:14.186528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4e43c1f5-7d03-4b31-b99a-369deb844c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:14.196007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1213/2414] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:14.200427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dac79-2e9d-4821-ab9b-6ede4e522935 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:14.210674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dac79-2e9d-4821-ab9b-6ede4e522935 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:14.215281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1c52c-643b-47ea-b7c9-4b50311f954e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:14.215933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1c52c-643b-47ea-b7c9-4b50311f954e admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.216223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1c52c-643b-47ea-b7c9-4b50311f954e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.216506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1c52c-643b-47ea-b7c9-4b50311f954e admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.217235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1c52c-643b-47ea-b7c9-4b50311f954e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:14.217548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1c52c-643b-47ea-b7c9-4b50311f954e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:14.219199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1c52c-643b-47ea-b7c9-4b50311f954e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:14.230648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1202/2415] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:14.234809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43c1f5-7d03-4b31-b99a-369deb844c8a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:14.244405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43c1f5-7d03-4b31-b99a-369deb844c8a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:14.249096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac5377-6aec-4853-80e7-e4c3c88d3973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:14.249754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac5377-6aec-4853-80e7-e4c3c88d3973 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.256517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac5377-6aec-4853-80e7-e4c3c88d3973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.256517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac5377-6aec-4853-80e7-e4c3c88d3973 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.256517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac5377-6aec-4853-80e7-e4c3c88d3973 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:14.256517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac5377-6aec-4853-80e7-e4c3c88d3973 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:14.370325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1214/2416] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:14 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:14.374254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1c52c-643b-47ea-b7c9-4b50311f954e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:14.385600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1c52c-643b-47ea-b7c9-4b50311f954e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:14.442960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425d61c-3413-4d85-a7db-1916531e8d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:14.444246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425d61c-3413-4d85-a7db-1916531e8d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.444640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425d61c-3413-4d85-a7db-1916531e8d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.444880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425d61c-3413-4d85-a7db-1916531e8d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.445563 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425d61c-3413-4d85-a7db-1916531e8d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:14.447555 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425d61c-3413-4d85-a7db-1916531e8d52 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:14.549695 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1203/2417] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:14 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:14.554653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac5377-6aec-4853-80e7-e4c3c88d3973 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:14.564825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac5377-6aec-4853-80e7-e4c3c88d3973 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:14.570691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba003f-534f-4314-9b84-b2c0f1800ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:14.571449 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba003f-534f-4314-9b84-b2c0f1800ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.571733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba003f-534f-4314-9b84-b2c0f1800ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.572007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba003f-534f-4314-9b84-b2c0f1800ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.572762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba003f-534f-4314-9b84-b2c0f1800ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:14.574347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba003f-534f-4314-9b84-b2c0f1800ecd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:14.585057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1215/2418] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:14.589078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425d61c-3413-4d85-a7db-1916531e8d52 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:14.599489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425d61c-3413-4d85-a7db-1916531e8d52 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:14.604382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc5308-76d5-4af4-8ae4-0d72a004654a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:14.605056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5308-76d5-4af4-8ae4-0d72a004654a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.605342 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5308-76d5-4af4-8ae4-0d72a004654a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.605622 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc5308-76d5-4af4-8ae4-0d72a004654a admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.606375 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc5308-76d5-4af4-8ae4-0d72a004654a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:14.608022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc5308-76d5-4af4-8ae4-0d72a004654a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:14.618633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1204/2419] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:14.622744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba003f-534f-4314-9b84-b2c0f1800ecd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:14.634390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba003f-534f-4314-9b84-b2c0f1800ecd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:14.639606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa15298-3c08-4f8c-a26d-ecfc0acb7810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:14.640781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15298-3c08-4f8c-a26d-ecfc0acb7810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.641067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15298-3c08-4f8c-a26d-ecfc0acb7810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.641354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15298-3c08-4f8c-a26d-ecfc0acb7810 admin admin] PATH_INFO: `/v3/projects/92826156746c445099e6d6a20923c98e/users/6845abf17dbe4466ab0cf2d4ea994301/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.657759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa15298-3c08-4f8c-a26d-ecfc0acb7810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92826156746c445099e6d6a20923c98e, user_id=6845abf17dbe4466ab0cf2d4ea994301, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:14.660681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa15298-3c08-4f8c-a26d-ecfc0acb7810 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:14.727077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1216/2420] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:14 2022] PUT /identity/v3/projects/92826156746c445099e6d6a20923c98e/users/6845abf17dbe4466ab0cf2d4ea994301/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:14.737187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589e27f-64bd-44ec-bb74-49233c6b6fb4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.737508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589e27f-64bd-44ec-bb74-49233c6b6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.737785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589e27f-64bd-44ec-bb74-49233c6b6fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.765051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9589e27f-64bd-44ec-bb74-49233c6b6fb4 None None] MFA Rules not processed for user `6845abf17dbe4466ab0cf2d4ea994301`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:14.766639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9589e27f-64bd-44ec-bb74-49233c6b6fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:14.832832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1205/2421] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:14.837842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa15298-3c08-4f8c-a26d-ecfc0acb7810 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:14.869407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:14.902567 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa15298-3c08-4f8c-a26d-ecfc0acb7810 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:14.907330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74394ef2-1750-491f-8810-183de1c0a8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:14.907997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74394ef2-1750-491f-8810-183de1c0a8ee admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:14.908287 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74394ef2-1750-491f-8810-183de1c0a8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:14.908606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74394ef2-1750-491f-8810-183de1c0a8ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:14.909312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74394ef2-1750-491f-8810-183de1c0a8ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:14.911267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74394ef2-1750-491f-8810-183de1c0a8ee admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:15.013605 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1217/2422] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:14 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:15.017836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589e27f-64bd-44ec-bb74-49233c6b6fb4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:15.031125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589e27f-64bd-44ec-bb74-49233c6b6fb4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:15.067223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:15.109585 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c191-d22c-4302-bf77-a18be69cf130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:15.110441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c191-d22c-4302-bf77-a18be69cf130 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:15.110800 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c191-d22c-4302-bf77-a18be69cf130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:15.111187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479c191-d22c-4302-bf77-a18be69cf130 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:15.111920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479c191-d22c-4302-bf77-a18be69cf130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:15.113963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479c191-d22c-4302-bf77-a18be69cf130 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:15.201444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1206/2423] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:15 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:15.205547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74394ef2-1750-491f-8810-183de1c0a8ee admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:15.216089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74394ef2-1750-491f-8810-183de1c0a8ee admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:15.221007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eac4a-54c5-4b67-bf21-25a9498f4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:15.221714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eac4a-54c5-4b67-bf21-25a9498f4241 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:15.222000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eac4a-54c5-4b67-bf21-25a9498f4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:15.222276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eac4a-54c5-4b67-bf21-25a9498f4241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:15.223035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eac4a-54c5-4b67-bf21-25a9498f4241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:15.224708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eac4a-54c5-4b67-bf21-25a9498f4241 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:15.236652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1218/2424] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:15.240986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c191-d22c-4302-bf77-a18be69cf130 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:15.251894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479c191-d22c-4302-bf77-a18be69cf130 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:15.259308 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3d04-23be-4bb2-80f6-a0637292efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:15.260197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3d04-23be-4bb2-80f6-a0637292efa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:15.260476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3d04-23be-4bb2-80f6-a0637292efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:15.260752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaf3d04-23be-4bb2-80f6-a0637292efa2 admin admin] PATH_INFO: `/v3/projects/3753a6e11a394da5ab816cb06308ac5c/users/0c08e07c5743487ca7841e3c28ea5088/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:15.279306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf3d04-23be-4bb2-80f6-a0637292efa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3753a6e11a394da5ab816cb06308ac5c, user_id=0c08e07c5743487ca7841e3c28ea5088, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:15.281966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaf3d04-23be-4bb2-80f6-a0637292efa2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:15.332328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1207/2425] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:15 2022] PUT /identity/v3/projects/3753a6e11a394da5ab816cb06308ac5c/users/0c08e07c5743487ca7841e3c28ea5088/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:15.336477 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eac4a-54c5-4b67-bf21-25a9498f4241 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:15.347572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eac4a-54c5-4b67-bf21-25a9498f4241 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:15.417486 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cec62-cb83-47e2-bef8-ea10e7ffaab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:15.418231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cec62-cb83-47e2-bef8-ea10e7ffaab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:15.418580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cec62-cb83-47e2-bef8-ea10e7ffaab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:15.418955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cec62-cb83-47e2-bef8-ea10e7ffaab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:15.419683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cec62-cb83-47e2-bef8-ea10e7ffaab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:15.421285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cec62-cb83-47e2-bef8-ea10e7ffaab7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:15.432296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1219/2426] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:15.436349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3d04-23be-4bb2-80f6-a0637292efa2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:15.449769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaf3d04-23be-4bb2-80f6-a0637292efa2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:15.452209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8dc64-a2a1-428b-abbc-c87f09d847dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:15.453102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8dc64-a2a1-428b-abbc-c87f09d847dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:15.453389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8dc64-a2a1-428b-abbc-c87f09d847dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:15.453668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8dc64-a2a1-428b-abbc-c87f09d847dd admin admin] PATH_INFO: `/v3/projects/3753a6e11a394da5ab816cb06308ac5c/users/0c08e07c5743487ca7841e3c28ea5088/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:15.455649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8dc64-a2a1-428b-abbc-c87f09d847dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3753a6e11a394da5ab816cb06308ac5c, user_id=0c08e07c5743487ca7841e3c28ea5088, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:15.458626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8dc64-a2a1-428b-abbc-c87f09d847dd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:15.471247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1208/2427] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:15 2022] PUT /identity/v3/projects/3753a6e11a394da5ab816cb06308ac5c/users/0c08e07c5743487ca7841e3c28ea5088/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:15.482180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f962-004b-4a06-9d29-c8779126f387 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:15.482470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f962-004b-4a06-9d29-c8779126f387 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:15.482752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f962-004b-4a06-9d29-c8779126f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:15.515869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5220f962-004b-4a06-9d29-c8779126f387 None None] MFA Rules not processed for user `0c08e07c5743487ca7841e3c28ea5088`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:15.518024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5220f962-004b-4a06-9d29-c8779126f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:15.587434 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1220/2428] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:15.598166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8dc64-a2a1-428b-abbc-c87f09d847dd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:15.600569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bfd8dc64-a2a1-428b-abbc-c87f09d847dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:15.661023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8dc64-a2a1-428b-abbc-c87f09d847dd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:15.665493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d62a7-928a-415c-805d-4805bdef1474 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:15.666141 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d62a7-928a-415c-805d-4805bdef1474 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:15.666427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d62a7-928a-415c-805d-4805bdef1474 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:15.666704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d62a7-928a-415c-805d-4805bdef1474 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:15.677442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d62a7-928a-415c-805d-4805bdef1474 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:15.679973 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d62a7-928a-415c-805d-4805bdef1474 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:15.690573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1209/2429] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:15.832124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220f962-004b-4a06-9d29-c8779126f387 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:15.841951 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220f962-004b-4a06-9d29-c8779126f387 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:15.846222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d622f6-9c75-44f5-88ad-7a29d076f98b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:15.848909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d622f6-9c75-44f5-88ad-7a29d076f98b service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:15.848909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d622f6-9c75-44f5-88ad-7a29d076f98b service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:15.848909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d622f6-9c75-44f5-88ad-7a29d076f98b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:15.870402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:15.910204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d622f6-9c75-44f5-88ad-7a29d076f98b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:15.911610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d622f6-9c75-44f5-88ad-7a29d076f98b service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:15.921535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1221/2430] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:52:18.988990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d62a7-928a-415c-805d-4805bdef1474 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:19.054699 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d62a7-928a-415c-805d-4805bdef1474 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:19.058364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:19.059305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:19.059593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:19.059876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] PATH_INFO: `/v3/users/6845abf17dbe4466ab0cf2d4ea994301` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:19.061323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6845abf17dbe4466ab0cf2d4ea994301)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:19.064056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:19.230888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:19.245490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6845abf17dbe4466ab0cf2d4ea994301'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:19.246208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6845abf17dbe4466ab0cf2d4ea994301'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:19.261799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6845abf17dbe4466ab0cf2d4ea994301'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:19.268968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6845abf17dbe4466ab0cf2d4ea994301'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:19.344489 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6845abf17dbe4466ab0cf2d4ea994301'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:19.351879 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1210/2431] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:18 2022] DELETE /identity/v3/users/6845abf17dbe4466ab0cf2d4ea994301 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:19.356629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec638d-a72e-44ba-9f52-5156ce3fc862 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:19.357093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec638d-a72e-44ba-9f52-5156ce3fc862 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:19.357188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec638d-a72e-44ba-9f52-5156ce3fc862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:19.385794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-36ec638d-a72e-44ba-9f52-5156ce3fc862 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:19.387090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-36ec638d-a72e-44ba-9f52-5156ce3fc862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:19.453802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1222/2432] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:19.474376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:19.476722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:19.550948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aafc72e-a031-461e-b7c7-6095f6a7cafd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:19.556383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35e883-384a-41b2-935c-cb66987dea40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:19.557050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e883-384a-41b2-935c-cb66987dea40 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:19.557347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e883-384a-41b2-935c-cb66987dea40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:19.557620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35e883-384a-41b2-935c-cb66987dea40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:19.568653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35e883-384a-41b2-935c-cb66987dea40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:19.570801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35e883-384a-41b2-935c-cb66987dea40 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:19.588299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1211/2433] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:20.316599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec638d-a72e-44ba-9f52-5156ce3fc862 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:20.318328 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-36ec638d-a72e-44ba-9f52-5156ce3fc862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:20.333950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec638d-a72e-44ba-9f52-5156ce3fc862 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:20.339024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:20.339983 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:20.340323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:20.340609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] PATH_INFO: `/v3/projects/92826156746c445099e6d6a20923c98e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:20.341823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92826156746c445099e6d6a20923c98e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:20.344034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:20.465629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92826156746c445099e6d6a20923c98e', 'request_id': 'req-a1722639-8aa6-40a0-b725-d8297dc20d0f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:20.478424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076a53-c009-4827-b877-7e3e07541710 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:20.479098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076a53-c009-4827-b877-7e3e07541710 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:20.479098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38076a53-c009-4827-b877-7e3e07541710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:20.497886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-38076a53-c009-4827-b877-7e3e07541710 None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:20.499172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-38076a53-c009-4827-b877-7e3e07541710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:20.539002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92826156746c445099e6d6a20923c98e', 'request_id': 'req-a1722639-8aa6-40a0-b725-d8297dc20d0f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:20.553727 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92826156746c445099e6d6a20923c98e', 'request_id': 'req-a1722639-8aa6-40a0-b725-d8297dc20d0f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:20.568383 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] The token cache is being invalidate because project 92826156746c445099e6d6a20923c98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:20.568676 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:20.569552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:20.570998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1212/2434] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:52:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:20.571381 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1223/2435] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:20 2022] DELETE /identity/v3/projects/92826156746c445099e6d6a20923c98e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:20.575795 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38076a53-c009-4827-b877-7e3e07541710 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:20.589037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:20.593325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:20.651169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:20.656597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:20.661869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38076a53-c009-4827-b877-7e3e07541710 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:20.667396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:20.668276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:20.668569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:20.668928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] PATH_INFO: `/v3/users/0c08e07c5743487ca7841e3c28ea5088` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:20.670152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c08e07c5743487ca7841e3c28ea5088)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:20.672226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:20.675481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1722639-8aa6-40a0-b725-d8297dc20d0f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:20.680750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:20.684837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:20.684837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:20.684837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:20.684837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:20.695958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:20.697619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:20.706304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1224/2436] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:52:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:52:20.930054 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c08e07c5743487ca7841e3c28ea5088'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:20.931369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c08e07c5743487ca7841e3c28ea5088'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:20.950621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c08e07c5743487ca7841e3c28ea5088'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:20.963662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c08e07c5743487ca7841e3c28ea5088'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:21.052659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d0d6af2f-90ac-4fdc-9a3d-64be73f7ae02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c08e07c5743487ca7841e3c28ea5088'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:21.069715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1213/2437] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:20 2022] DELETE /identity/v3/users/0c08e07c5743487ca7841e3c28ea5088 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:21.604710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:21.606152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:21.620472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a715e5a-2a51-4f9c-964f-0a0a48244e9e service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:21.703831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:21.705606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:21.706361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:21.706881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] PATH_INFO: `/v3/projects/3753a6e11a394da5ab816cb06308ac5c` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:21.708501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3753a6e11a394da5ab816cb06308ac5c)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:21.711188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:21.838747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3753a6e11a394da5ab816cb06308ac5c', 'request_id': 'req-971d3e8e-e2a3-4d08-be34-9693b2d963e2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:21.908741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3753a6e11a394da5ab816cb06308ac5c', 'request_id': 'req-971d3e8e-e2a3-4d08-be34-9693b2d963e2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:21.916510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3753a6e11a394da5ab816cb06308ac5c', 'request_id': 'req-971d3e8e-e2a3-4d08-be34-9693b2d963e2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:21.932681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] The token cache is being invalidate because project 3753a6e11a394da5ab816cb06308ac5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:21.933058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:21.933858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-971d3e8e-e2a3-4d08-be34-9693b2d963e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:21.938998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1225/2438] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:21 2022] DELETE /identity/v3/projects/3753a6e11a394da5ab816cb06308ac5c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:21.941575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e836-c4f0-435e-a9e1-5cc6c9022b53 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:21.942972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e836-c4f0-435e-a9e1-5cc6c9022b53 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:21.942972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e836-c4f0-435e-a9e1-5cc6c9022b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:21.963414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-abe3e836-c4f0-435e-a9e1-5cc6c9022b53 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:21.964651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-abe3e836-c4f0-435e-a9e1-5cc6c9022b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:22.067968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1214/2439] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:22.071958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deae57-628c-4457-8018-7906cbf6b733 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:22.071958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deae57-628c-4457-8018-7906cbf6b733 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:22.072656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deae57-628c-4457-8018-7906cbf6b733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:22.099437 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-19deae57-628c-4457-8018-7906cbf6b733 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:22.101280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-19deae57-628c-4457-8018-7906cbf6b733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:22.117612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1226/2440] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:22.121962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3e836-c4f0-435e-a9e1-5cc6c9022b53 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:22.137485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3e836-c4f0-435e-a9e1-5cc6c9022b53 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:22.151780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a15d7-2042-4436-90e0-ad522cd5c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:22.152534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a15d7-2042-4436-90e0-ad522cd5c0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:22.152877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a15d7-2042-4436-90e0-ad522cd5c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:22.153296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a15d7-2042-4436-90e0-ad522cd5c0c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:22.154050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a15d7-2042-4436-90e0-ad522cd5c0c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:22.154368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a15d7-2042-4436-90e0-ad522cd5c0c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:22.156040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a15d7-2042-4436-90e0-ad522cd5c0c6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:22.171870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1215/2441] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:22.175981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19deae57-628c-4457-8018-7906cbf6b733 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:22.189338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19deae57-628c-4457-8018-7906cbf6b733 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:22.194785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd76d67-a5f5-44fb-bf83-5123adbc7f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:22.195512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76d67-a5f5-44fb-bf83-5123adbc7f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:22.195801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76d67-a5f5-44fb-bf83-5123adbc7f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:22.196191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd76d67-a5f5-44fb-bf83-5123adbc7f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:22.197015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd76d67-a5f5-44fb-bf83-5123adbc7f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:22.199058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd76d67-a5f5-44fb-bf83-5123adbc7f75 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:22.313536 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1227/2442] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:22 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:22.317202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a15d7-2042-4436-90e0-ad522cd5c0c6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:22.333464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a15d7-2042-4436-90e0-ad522cd5c0c6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:22.411969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5358-9b04-4db5-975e-605f7f48edf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:22.412909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5358-9b04-4db5-975e-605f7f48edf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:22.413240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5358-9b04-4db5-975e-605f7f48edf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:22.413532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5358-9b04-4db5-975e-605f7f48edf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:22.414243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5358-9b04-4db5-975e-605f7f48edf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:22.417129 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5358-9b04-4db5-975e-605f7f48edf6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:22.427468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:22.527324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1216/2443] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:22 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:22.531387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd76d67-a5f5-44fb-bf83-5123adbc7f75 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:22.551135 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd76d67-a5f5-44fb-bf83-5123adbc7f75 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:22.556076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9df01-2ba0-4351-9433-a191fa041bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:22.556768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9df01-2ba0-4351-9433-a191fa041bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:22.557048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9df01-2ba0-4351-9433-a191fa041bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:22.557325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9df01-2ba0-4351-9433-a191fa041bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:22.558055 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9df01-2ba0-4351-9433-a191fa041bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:22.559687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9df01-2ba0-4351-9433-a191fa041bd2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:22.574781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1228/2444] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:22.576271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5358-9b04-4db5-975e-605f7f48edf6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:22.598438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5358-9b04-4db5-975e-605f7f48edf6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:22.602969 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb1fef-bbf2-419b-941c-2381d756d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:22.607915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb1fef-bbf2-419b-941c-2381d756d484 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:22.608209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb1fef-bbf2-419b-941c-2381d756d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:22.608496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb1fef-bbf2-419b-941c-2381d756d484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:22.609388 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb1fef-bbf2-419b-941c-2381d756d484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:22.611264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb1fef-bbf2-419b-941c-2381d756d484 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:22.655520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1217/2445] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:52:22.658677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9df01-2ba0-4351-9433-a191fa041bd2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:22.690489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9df01-2ba0-4351-9433-a191fa041bd2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:22.692110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda0165-7b5a-4442-97d0-dead7f85bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:22.693016 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda0165-7b5a-4442-97d0-dead7f85bf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:22.693305 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda0165-7b5a-4442-97d0-dead7f85bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:22.693596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda0165-7b5a-4442-97d0-dead7f85bf78 admin admin] PATH_INFO: `/v3/projects/d7c3ee349a454a38ae4874ab465da03c/users/71afc733d652421e8c521847b628f2c5/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:22.746221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda0165-7b5a-4442-97d0-dead7f85bf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c3ee349a454a38ae4874ab465da03c, user_id=71afc733d652421e8c521847b628f2c5, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:22.749382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda0165-7b5a-4442-97d0-dead7f85bf78 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:22.843270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:22.849039 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1229/2446] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:22 2022] PUT /identity/v3/projects/d7c3ee349a454a38ae4874ab465da03c/users/71afc733d652421e8c521847b628f2c5/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:22.860232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be824-6580-4569-ab50-7568d9790ce0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:22.860574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be824-6580-4569-ab50-7568d9790ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:22.860862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21be824-6580-4569-ab50-7568d9790ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:22.897352 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d21be824-6580-4569-ab50-7568d9790ce0 None None] MFA Rules not processed for user `71afc733d652421e8c521847b628f2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:22.899339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d21be824-6580-4569-ab50-7568d9790ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:22.996240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1218/2447] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:22.997462 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda0165-7b5a-4442-97d0-dead7f85bf78 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:23.080762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda0165-7b5a-4442-97d0-dead7f85bf78 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:23.086184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab9d26-6b79-4614-85e2-28b87053631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:23.086887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab9d26-6b79-4614-85e2-28b87053631d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:23.087180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab9d26-6b79-4614-85e2-28b87053631d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:23.087460 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab9d26-6b79-4614-85e2-28b87053631d admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:23.088166 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab9d26-6b79-4614-85e2-28b87053631d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:23.090097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab9d26-6b79-4614-85e2-28b87053631d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:23.180397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1230/2448] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:22 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:23.184391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be824-6580-4569-ab50-7568d9790ce0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:23.201013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21be824-6580-4569-ab50-7568d9790ce0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:23.282957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ba5b-8f95-43ce-afec-0b9b9f784a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:23.283646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ba5b-8f95-43ce-afec-0b9b9f784a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:23.284270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ba5b-8f95-43ce-afec-0b9b9f784a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:23.284535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ba5b-8f95-43ce-afec-0b9b9f784a9b admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:23.285336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852ba5b-8f95-43ce-afec-0b9b9f784a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:23.287454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852ba5b-8f95-43ce-afec-0b9b9f784a9b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:23.398881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1219/2449] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:23 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:23.400934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab9d26-6b79-4614-85e2-28b87053631d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:23.416309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab9d26-6b79-4614-85e2-28b87053631d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:23.433223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb506a79-fc8a-4231-b2fc-197074a3b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:23.434074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb506a79-fc8a-4231-b2fc-197074a3b4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:23.434423 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb506a79-fc8a-4231-b2fc-197074a3b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:23.434704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb506a79-fc8a-4231-b2fc-197074a3b4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:23.435782 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb506a79-fc8a-4231-b2fc-197074a3b4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:23.437509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb506a79-fc8a-4231-b2fc-197074a3b4c2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:23.452426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1231/2450] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:23.453572 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ba5b-8f95-43ce-afec-0b9b9f784a9b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:23.465926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ba5b-8f95-43ce-afec-0b9b9f784a9b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:23.476801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40931ae-adf5-436e-9fed-292e9a906a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:23.477723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40931ae-adf5-436e-9fed-292e9a906a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:23.477999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40931ae-adf5-436e-9fed-292e9a906a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:23.478274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40931ae-adf5-436e-9fed-292e9a906a97 admin admin] PATH_INFO: `/v3/projects/d42c7be9e23a48bdb2dde3d3cd13f232/users/ec3f3fc5a236437aa99411146d2c86f5/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:23.496967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40931ae-adf5-436e-9fed-292e9a906a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42c7be9e23a48bdb2dde3d3cd13f232, user_id=ec3f3fc5a236437aa99411146d2c86f5, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:23.499828 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40931ae-adf5-436e-9fed-292e9a906a97 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:23.624503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1220/2451] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:23 2022] PUT /identity/v3/projects/d42c7be9e23a48bdb2dde3d3cd13f232/users/ec3f3fc5a236437aa99411146d2c86f5/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:23.628547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb506a79-fc8a-4231-b2fc-197074a3b4c2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:23.642193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb506a79-fc8a-4231-b2fc-197074a3b4c2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:23.704629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24056c5f-db45-4741-91d4-55477969c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:23.705312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056c5f-db45-4741-91d4-55477969c822 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:23.705580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056c5f-db45-4741-91d4-55477969c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:23.705855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056c5f-db45-4741-91d4-55477969c822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:23.706597 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24056c5f-db45-4741-91d4-55477969c822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:23.708353 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24056c5f-db45-4741-91d4-55477969c822 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:23.719638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1232/2452] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:23.724183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40931ae-adf5-436e-9fed-292e9a906a97 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:23.735951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40931ae-adf5-436e-9fed-292e9a906a97 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:23.741277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64e89f-1f6f-42aa-ae08-10db70f20a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:23.742250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64e89f-1f6f-42aa-ae08-10db70f20a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:23.742643 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64e89f-1f6f-42aa-ae08-10db70f20a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:23.743063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64e89f-1f6f-42aa-ae08-10db70f20a08 admin admin] PATH_INFO: `/v3/projects/d42c7be9e23a48bdb2dde3d3cd13f232/users/ec3f3fc5a236437aa99411146d2c86f5/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:23.745413 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64e89f-1f6f-42aa-ae08-10db70f20a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42c7be9e23a48bdb2dde3d3cd13f232, user_id=ec3f3fc5a236437aa99411146d2c86f5, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:23.748390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64e89f-1f6f-42aa-ae08-10db70f20a08 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:23.760704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1221/2453] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:23 2022] PUT /identity/v3/projects/d42c7be9e23a48bdb2dde3d3cd13f232/users/ec3f3fc5a236437aa99411146d2c86f5/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:23.773444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06835a6-193f-478c-bf9f-03d7fd1f7bb3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:23.773444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06835a6-193f-478c-bf9f-03d7fd1f7bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:23.773726 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06835a6-193f-478c-bf9f-03d7fd1f7bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:23.803351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d06835a6-193f-478c-bf9f-03d7fd1f7bb3 None None] MFA Rules not processed for user `ec3f3fc5a236437aa99411146d2c86f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:23.805301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d06835a6-193f-478c-bf9f-03d7fd1f7bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:23.871946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:23.883018 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1233/2454] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:23.895919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64e89f-1f6f-42aa-ae08-10db70f20a08 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:23.898117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2f64e89f-1f6f-42aa-ae08-10db70f20a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:23.933582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:23.969004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64e89f-1f6f-42aa-ae08-10db70f20a08 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:23.972935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3fdf49-02b8-480a-8e5f-d20a18eed647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:23.973664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fdf49-02b8-480a-8e5f-d20a18eed647 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:23.974021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fdf49-02b8-480a-8e5f-d20a18eed647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:23.974367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3fdf49-02b8-480a-8e5f-d20a18eed647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:23.985620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fdf49-02b8-480a-8e5f-d20a18eed647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:23.987484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3fdf49-02b8-480a-8e5f-d20a18eed647 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:23.998383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1222/2455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:25.952952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06835a6-193f-478c-bf9f-03d7fd1f7bb3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:26.026099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06835a6-193f-478c-bf9f-03d7fd1f7bb3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:26.030792 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:26.031751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:26.032115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:26.032342 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] PATH_INFO: `/v3/users/71afc733d652421e8c521847b628f2c5` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:26.033570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71afc733d652421e8c521847b628f2c5)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:26.035544 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:26.215790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71afc733d652421e8c521847b628f2c5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:26.229343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71afc733d652421e8c521847b628f2c5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:26.326054 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71afc733d652421e8c521847b628f2c5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:26.326723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71afc733d652421e8c521847b628f2c5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:26.335508 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71afc733d652421e8c521847b628f2c5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:26.341701 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1234/2456] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:25 2022] DELETE /identity/v3/users/71afc733d652421e8c521847b628f2c5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:26.346180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5026-2a01-40a5-bef1-ad6f8590675d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:26.346818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5026-2a01-40a5-bef1-ad6f8590675d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:26.346961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5026-2a01-40a5-bef1-ad6f8590675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:26.368715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-061c5026-2a01-40a5-bef1-ad6f8590675d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:26.369953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-061c5026-2a01-40a5-bef1-ad6f8590675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:26.445539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1223/2457] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:26.452347 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:26.453836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:26.517634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dec4b-d1c4-4bfb-a1e8-e40aeb89492d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:26.521527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d6ebe-47e4-46ef-b475-0bb0a9beed2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:26.522303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d6ebe-47e4-46ef-b475-0bb0a9beed2e service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:26.522638 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d6ebe-47e4-46ef-b475-0bb0a9beed2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:26.523006 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d6ebe-47e4-46ef-b475-0bb0a9beed2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:26.532711 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d6ebe-47e4-46ef-b475-0bb0a9beed2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:26.534228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d6ebe-47e4-46ef-b475-0bb0a9beed2e service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:26.544646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1235/2458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:27.031741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5026-2a01-40a5-bef1-ad6f8590675d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:27.035814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-061c5026-2a01-40a5-bef1-ad6f8590675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:27.050050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5026-2a01-40a5-bef1-ad6f8590675d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:27.056510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:27.057466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:27.057759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:27.058088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] PATH_INFO: `/v3/projects/d7c3ee349a454a38ae4874ab465da03c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:27.059349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c3ee349a454a38ae4874ab465da03c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:27.061454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:27.206304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c3ee349a454a38ae4874ab465da03c', 'request_id': 'req-0bfe8d2c-7553-4455-b364-ec60ba273726'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.213701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c3ee349a454a38ae4874ab465da03c', 'request_id': 'req-0bfe8d2c-7553-4455-b364-ec60ba273726'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.304362 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c3ee349a454a38ae4874ab465da03c', 'request_id': 'req-0bfe8d2c-7553-4455-b364-ec60ba273726'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.320303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] The token cache is being invalidate because project d7c3ee349a454a38ae4874ab465da03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:27.320303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.324033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.324033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1224/2459] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:27 2022] DELETE /identity/v3/projects/d7c3ee349a454a38ae4874ab465da03c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:27.326651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d6ebe-47e4-46ef-b475-0bb0a9beed2e service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:27.340404 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d6ebe-47e4-46ef-b475-0bb0a9beed2e service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:27.355818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:27.415054 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:27.416202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:27.416761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:27.417219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] PATH_INFO: `/v3/users/ec3f3fc5a236437aa99411146d2c86f5` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:27.418942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3f3fc5a236437aa99411146d2c86f5)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:27.421067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:27.592504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3f3fc5a236437aa99411146d2c86f5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.607329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3f3fc5a236437aa99411146d2c86f5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.703048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3f3fc5a236437aa99411146d2c86f5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.703662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3f3fc5a236437aa99411146d2c86f5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.711385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d5655d77-a546-4e3b-8080-d6fd49dd94da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3f3fc5a236437aa99411146d2c86f5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:27.717210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1236/2460] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:27 2022] DELETE /identity/v3/users/ec3f3fc5a236437aa99411146d2c86f5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:28.150716 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:28.153069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:28.174869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe8d2c-7553-4455-b364-ec60ba273726 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:28.266190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:28.278060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:28.279236 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:28.279689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:28.280237 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] PATH_INFO: `/v3/projects/d42c7be9e23a48bdb2dde3d3cd13f232` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:28.281551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42c7be9e23a48bdb2dde3d3cd13f232)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:28.283817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:28.424893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42c7be9e23a48bdb2dde3d3cd13f232', 'request_id': 'req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:28.438825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42c7be9e23a48bdb2dde3d3cd13f232', 'request_id': 'req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:28.525914 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42c7be9e23a48bdb2dde3d3cd13f232', 'request_id': 'req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:28.545148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] The token cache is being invalidate because project d42c7be9e23a48bdb2dde3d3cd13f232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:28.545535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:28.546443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:28.555577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01286d98-647d-4c4b-91c8-c2f04959ca89 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:28.556083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01286d98-647d-4c4b-91c8-c2f04959ca89 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:28.561845 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01286d98-647d-4c4b-91c8-c2f04959ca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:28.563353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1225/2461] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:28 2022] DELETE /identity/v3/projects/d42c7be9e23a48bdb2dde3d3cd13f232 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:28.570665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:28.572115 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:28.583644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-01286d98-647d-4c4b-91c8-c2f04959ca89 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:28.585891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-01286d98-647d-4c4b-91c8-c2f04959ca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:28.719701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ff9a3-9452-400e-b0fe-b256bfcd3cb3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:28.719996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5446144-2b16-407f-abdf-7c622497dc17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:28.720645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446144-2b16-407f-abdf-7c622497dc17 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:28.720927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446144-2b16-407f-abdf-7c622497dc17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:28.721202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446144-2b16-407f-abdf-7c622497dc17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:28.723454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c5446144-2b16-407f-abdf-7c622497dc17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:28.741861 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1237/2462] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:28.750080 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d0102-7dcb-46a8-820b-6101ff85becf None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:28.750440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d0102-7dcb-46a8-820b-6101ff85becf None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:28.750803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d0102-7dcb-46a8-820b-6101ff85becf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:28.776030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f45d0102-7dcb-46a8-820b-6101ff85becf None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:28.777456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f45d0102-7dcb-46a8-820b-6101ff85becf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:28.788650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1238/2463] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:28.796265 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d0102-7dcb-46a8-820b-6101ff85becf None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:28.808331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d0102-7dcb-46a8-820b-6101ff85becf None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:28.809789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5446144-2b16-407f-abdf-7c622497dc17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:28.811231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5446144-2b16-407f-abdf-7c622497dc17 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:28.815136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab1e1c-830a-48d8-84a7-a7009951b936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:28.815947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab1e1c-830a-48d8-84a7-a7009951b936 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:28.816651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab1e1c-830a-48d8-84a7-a7009951b936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:28.816941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab1e1c-830a-48d8-84a7-a7009951b936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:28.819429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab1e1c-830a-48d8-84a7-a7009951b936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:28.819914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab1e1c-830a-48d8-84a7-a7009951b936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:28.821697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ab1e1c-830a-48d8-84a7-a7009951b936 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:28.824852 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1226/2464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:28.838939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1239/2465] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:28.843339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5446144-2b16-407f-abdf-7c622497dc17 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:28.858558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5446144-2b16-407f-abdf-7c622497dc17 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:28.877021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace9829-4eb1-4d4a-a6fa-0620c69da8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:28.877785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace9829-4eb1-4d4a-a6fa-0620c69da8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:28.878069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace9829-4eb1-4d4a-a6fa-0620c69da8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:28.879028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace9829-4eb1-4d4a-a6fa-0620c69da8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:28.879734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace9829-4eb1-4d4a-a6fa-0620c69da8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:28.883767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ace9829-4eb1-4d4a-a6fa-0620c69da8aa admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:28.992585 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1227/2466] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:28 2022] POST /identity/v3/projects => generated 361 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:28.996677 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab1e1c-830a-48d8-84a7-a7009951b936 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:29.007161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ab1e1c-830a-48d8-84a7-a7009951b936 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:29.022703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:29.073888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b7318-0922-4ad1-bad4-bc8d7a142b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:29.074991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b7318-0922-4ad1-bad4-bc8d7a142b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:29.075533 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b7318-0922-4ad1-bad4-bc8d7a142b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:29.076023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b7318-0922-4ad1-bad4-bc8d7a142b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:29.076938 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b7318-0922-4ad1-bad4-bc8d7a142b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:29.079143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b7318-0922-4ad1-bad4-bc8d7a142b57 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:29.161211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1240/2467] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:28 2022] POST /identity/v3/users => generated 281 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:29.165931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace9829-4eb1-4d4a-a6fa-0620c69da8aa admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:29.176632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace9829-4eb1-4d4a-a6fa-0620c69da8aa admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:29.182218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d675-0d8e-482d-8f50-5448a0f89d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:29.182923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d675-0d8e-482d-8f50-5448a0f89d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:29.183211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d675-0d8e-482d-8f50-5448a0f89d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:29.183488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d675-0d8e-482d-8f50-5448a0f89d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:29.184227 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d675-0d8e-482d-8f50-5448a0f89d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:29.185869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d675-0d8e-482d-8f50-5448a0f89d3c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:29.188383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:29.203118 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1228/2468] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:29.206982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b7318-0922-4ad1-bad4-bc8d7a142b57 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:29.218242 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b7318-0922-4ad1-bad4-bc8d7a142b57 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:29.223321 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38193a45-4137-485e-a144-41601931ce44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:29.224013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38193a45-4137-485e-a144-41601931ce44 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:29.224300 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38193a45-4137-485e-a144-41601931ce44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:29.224578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38193a45-4137-485e-a144-41601931ce44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:29.226333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38193a45-4137-485e-a144-41601931ce44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:29.228395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38193a45-4137-485e-a144-41601931ce44 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:29.246627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1241/2469] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:29.247578 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d675-0d8e-482d-8f50-5448a0f89d3c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:29.261783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d675-0d8e-482d-8f50-5448a0f89d3c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:29.267211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638944aa-76f4-4220-9492-a9d80d29f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:29.268187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638944aa-76f4-4220-9492-a9d80d29f172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:29.268464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638944aa-76f4-4220-9492-a9d80d29f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:29.268928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638944aa-76f4-4220-9492-a9d80d29f172 admin admin] PATH_INFO: `/v3/projects/e25faeb9d3e64f43882e160060651e0d/users/6bdaee662cab494aa0d1f9eaa6369994/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:29.285427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638944aa-76f4-4220-9492-a9d80d29f172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25faeb9d3e64f43882e160060651e0d, user_id=6bdaee662cab494aa0d1f9eaa6369994, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:29.289123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638944aa-76f4-4220-9492-a9d80d29f172 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:29.378031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1229/2470] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:29 2022] PUT /identity/v3/projects/e25faeb9d3e64f43882e160060651e0d/users/6bdaee662cab494aa0d1f9eaa6369994/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:29.389788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38eb09-4f9d-4521-8733-a4eb243d2558 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:29.390098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38eb09-4f9d-4521-8733-a4eb243d2558 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:29.390630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38eb09-4f9d-4521-8733-a4eb243d2558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:29.420884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2e38eb09-4f9d-4521-8733-a4eb243d2558 None None] MFA Rules not processed for user `6bdaee662cab494aa0d1f9eaa6369994`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:29.422337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2e38eb09-4f9d-4521-8733-a4eb243d2558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:29.494005 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1242/2471] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:29.528558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638944aa-76f4-4220-9492-a9d80d29f172 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:29.530389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-638944aa-76f4-4220-9492-a9d80d29f172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:29.595357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638944aa-76f4-4220-9492-a9d80d29f172 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:29.599175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9cf2a0-d8ea-4338-af8e-bdfb798410af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:29.599827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cf2a0-d8ea-4338-af8e-bdfb798410af service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:29.600157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cf2a0-d8ea-4338-af8e-bdfb798410af service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:29.600437 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9cf2a0-d8ea-4338-af8e-bdfb798410af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:29.609184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cf2a0-d8ea-4338-af8e-bdfb798410af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:29.610628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9cf2a0-d8ea-4338-af8e-bdfb798410af service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:29.620068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1230/2472] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:29.634695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38eb09-4f9d-4521-8733-a4eb243d2558 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:29.699941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38eb09-4f9d-4521-8733-a4eb243d2558 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:29.704523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:29.705428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:29.705716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:29.705996 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] PATH_INFO: `/v3/users/6bdaee662cab494aa0d1f9eaa6369994` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:29.707336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdaee662cab494aa0d1f9eaa6369994)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:29.709293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:29.791974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:29.898660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdaee662cab494aa0d1f9eaa6369994'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:29.912003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdaee662cab494aa0d1f9eaa6369994'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:29.989382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdaee662cab494aa0d1f9eaa6369994'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:29.990072 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdaee662cab494aa0d1f9eaa6369994'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:29.998041 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdaee662cab494aa0d1f9eaa6369994'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:30.004180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1243/2473] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:29 2022] DELETE /identity/v3/users/6bdaee662cab494aa0d1f9eaa6369994 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:30.015197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d471f0-489d-4a3d-a382-7cbb1f40ba91 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:30.015872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d471f0-489d-4a3d-a382-7cbb1f40ba91 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:30.016150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d471f0-489d-4a3d-a382-7cbb1f40ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:30.034216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-90d471f0-489d-4a3d-a382-7cbb1f40ba91 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:30.035472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-90d471f0-489d-4a3d-a382-7cbb1f40ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:30.111831 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1231/2474] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:30.126046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:30.127982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:30.189513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3f8b5-164d-4f3a-beea-2794f120a5b4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:30.193117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7c353-58cb-4554-ac88-85f8b5418e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:30.194430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7c353-58cb-4554-ac88-85f8b5418e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:30.194720 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7c353-58cb-4554-ac88-85f8b5418e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:30.195031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7c353-58cb-4554-ac88-85f8b5418e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:30.203912 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7c353-58cb-4554-ac88-85f8b5418e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:30.205325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7c353-58cb-4554-ac88-85f8b5418e94 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:30.215208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1244/2475] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:30.918564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d471f0-489d-4a3d-a382-7cbb1f40ba91 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:30.920180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-90d471f0-489d-4a3d-a382-7cbb1f40ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:30.935360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d471f0-489d-4a3d-a382-7cbb1f40ba91 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:30.940250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:30.942972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:30.942972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:30.942972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] PATH_INFO: `/v3/projects/e25faeb9d3e64f43882e160060651e0d` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:30.944688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25faeb9d3e64f43882e160060651e0d)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:30.954333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:31.077111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25faeb9d3e64f43882e160060651e0d', 'request_id': 'req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:31.085013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25faeb9d3e64f43882e160060651e0d', 'request_id': 'req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:31.165788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25faeb9d3e64f43882e160060651e0d', 'request_id': 'req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:31.181043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:31.182611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] The token cache is being invalidate because project e25faeb9d3e64f43882e160060651e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:31.183170 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:31.183925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bfe7711a-5081-4f01-b27f-2a8b82bb8b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:31.185862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1232/2476] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:30 2022] DELETE /identity/v3/projects/e25faeb9d3e64f43882e160060651e0d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:31.190664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b3115-18f1-4fed-9de8-e5ecb9e4d63e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:31.191182 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b3115-18f1-4fed-9de8-e5ecb9e4d63e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:31.191280 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b3115-18f1-4fed-9de8-e5ecb9e4d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:31.211091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-878b3115-18f1-4fed-9de8-e5ecb9e4d63e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:31.212255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-878b3115-18f1-4fed-9de8-e5ecb9e4d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:31.280867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1245/2477] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:31.289817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f9caf-8f44-444c-85a5-b76be229ee4a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:31.290199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f9caf-8f44-444c-85a5-b76be229ee4a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:31.290499 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f9caf-8f44-444c-85a5-b76be229ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:31.312434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8b6f9caf-8f44-444c-85a5-b76be229ee4a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:31.313841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8b6f9caf-8f44-444c-85a5-b76be229ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:31.327208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1233/2478] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:31.329067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b3115-18f1-4fed-9de8-e5ecb9e4d63e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:31.342610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b3115-18f1-4fed-9de8-e5ecb9e4d63e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:31.350012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49141a8c-0cd2-475f-98a4-b3d25b8228d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:31.350886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49141a8c-0cd2-475f-98a4-b3d25b8228d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:31.351210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49141a8c-0cd2-475f-98a4-b3d25b8228d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:31.351571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49141a8c-0cd2-475f-98a4-b3d25b8228d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:31.352545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49141a8c-0cd2-475f-98a4-b3d25b8228d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:31.352956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49141a8c-0cd2-475f-98a4-b3d25b8228d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:31.354650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49141a8c-0cd2-475f-98a4-b3d25b8228d1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:31.370572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1246/2479] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:31.375005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f9caf-8f44-444c-85a5-b76be229ee4a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:31.386524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f9caf-8f44-444c-85a5-b76be229ee4a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:31.391827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435a708-9038-40b5-afdb-f5e86d30c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:31.392627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a708-9038-40b5-afdb-f5e86d30c6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:31.394727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a708-9038-40b5-afdb-f5e86d30c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:31.394727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435a708-9038-40b5-afdb-f5e86d30c6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:31.395444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435a708-9038-40b5-afdb-f5e86d30c6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:31.397685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435a708-9038-40b5-afdb-f5e86d30c6d2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:31.516747 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1234/2480] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:31 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:31.520978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49141a8c-0cd2-475f-98a4-b3d25b8228d1 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:31.531499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49141a8c-0cd2-475f-98a4-b3d25b8228d1 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:31.570234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:31.603154 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a2e86-d091-4626-93bf-ec51674d1ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:31.605851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a2e86-d091-4626-93bf-ec51674d1ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:31.605851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a2e86-d091-4626-93bf-ec51674d1ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:31.605851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a2e86-d091-4626-93bf-ec51674d1ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:31.605851 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a2e86-d091-4626-93bf-ec51674d1ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:31.608603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a2e86-d091-4626-93bf-ec51674d1ce0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:31.707147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1247/2481] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:31 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:31.708404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435a708-9038-40b5-afdb-f5e86d30c6d2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:31.719560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435a708-9038-40b5-afdb-f5e86d30c6d2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:31.724226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f4c91-aae9-47d3-ac56-817e3bb46a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:31.730135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4c91-aae9-47d3-ac56-817e3bb46a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:31.730135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4c91-aae9-47d3-ac56-817e3bb46a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:31.730135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f4c91-aae9-47d3-ac56-817e3bb46a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:31.730135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f4c91-aae9-47d3-ac56-817e3bb46a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:31.731018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f4c91-aae9-47d3-ac56-817e3bb46a43 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:31.743221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1235/2482] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:31.747339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a2e86-d091-4626-93bf-ec51674d1ce0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:31.758952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a2e86-d091-4626-93bf-ec51674d1ce0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:31.764764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae9ad6-fac9-4bd0-967c-a00ce7d1c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:31.764764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae9ad6-fac9-4bd0-967c-a00ce7d1c0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:31.764764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae9ad6-fac9-4bd0-967c-a00ce7d1c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:31.764764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae9ad6-fac9-4bd0-967c-a00ce7d1c0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:31.765959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae9ad6-fac9-4bd0-967c-a00ce7d1c0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:31.767764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae9ad6-fac9-4bd0-967c-a00ce7d1c0a0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:31.779499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1248/2483] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:31.783421 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f4c91-aae9-47d3-ac56-817e3bb46a43 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:31.799363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f4c91-aae9-47d3-ac56-817e3bb46a43 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:31.804820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54432be-da0d-4cbb-9fad-ab75fd90f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:31.805754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54432be-da0d-4cbb-9fad-ab75fd90f1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:31.806038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54432be-da0d-4cbb-9fad-ab75fd90f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:31.806315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54432be-da0d-4cbb-9fad-ab75fd90f1d1 admin admin] PATH_INFO: `/v3/projects/39a73090edaf41999559912e6927bb3f/users/c4ec97db9726490aab2d43d20d19dc6a/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:31.824593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54432be-da0d-4cbb-9fad-ab75fd90f1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a73090edaf41999559912e6927bb3f, user_id=c4ec97db9726490aab2d43d20d19dc6a, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:31.833343 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54432be-da0d-4cbb-9fad-ab75fd90f1d1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:31.900664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1236/2484] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:31 2022] PUT /identity/v3/projects/39a73090edaf41999559912e6927bb3f/users/c4ec97db9726490aab2d43d20d19dc6a/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:31.910923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be12c-daf7-4cf1-99a7-98394722c238 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:31.914809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be12c-daf7-4cf1-99a7-98394722c238 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:31.914809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752be12c-daf7-4cf1-99a7-98394722c238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:31.939816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-752be12c-daf7-4cf1-99a7-98394722c238 None None] MFA Rules not processed for user `c4ec97db9726490aab2d43d20d19dc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:31.941094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-752be12c-daf7-4cf1-99a7-98394722c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:32.006680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1249/2485] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:32.018282 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54432be-da0d-4cbb-9fad-ab75fd90f1d1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:32.020167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d54432be-da0d-4cbb-9fad-ab75fd90f1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:32.081300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54432be-da0d-4cbb-9fad-ab75fd90f1d1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:32.085049 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213c621-370b-4d9b-bea4-703f743678ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:32.085710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213c621-370b-4d9b-bea4-703f743678ef service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:32.085993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213c621-370b-4d9b-bea4-703f743678ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:32.086269 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213c621-370b-4d9b-bea4-703f743678ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:32.094744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213c621-370b-4d9b-bea4-703f743678ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:32.096254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213c621-370b-4d9b-bea4-703f743678ef service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:32.106568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1237/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:33.218815 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752be12c-daf7-4cf1-99a7-98394722c238 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:33.220790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-752be12c-daf7-4cf1-99a7-98394722c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:33.293480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752be12c-daf7-4cf1-99a7-98394722c238 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:33.298195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:33.299102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:33.299390 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:33.299668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] PATH_INFO: `/v3/users/4a762aa672f5465da0f7cbc67ea7af9b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:33.300870 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a762aa672f5465da0f7cbc67ea7af9b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:33.302793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:33.498255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:33.499894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a762aa672f5465da0f7cbc67ea7af9b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:33.512952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a762aa672f5465da0f7cbc67ea7af9b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:33.646615 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a762aa672f5465da0f7cbc67ea7af9b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:33.647546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a762aa672f5465da0f7cbc67ea7af9b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:33.654894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-54054434-d8d5-41a8-8c1c-60ebf61963cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a762aa672f5465da0f7cbc67ea7af9b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:33.661108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1250/2487] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:33 2022] DELETE /identity/v3/users/4a762aa672f5465da0f7cbc67ea7af9b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:33.893082 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213c621-370b-4d9b-bea4-703f743678ef service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:33.906295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213c621-370b-4d9b-bea4-703f743678ef service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:33.933463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73a376-9c27-4a44-bc82-fa97f9ab5c2d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:33.937366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73a376-9c27-4a44-bc82-fa97f9ab5c2d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:33.937366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73a376-9c27-4a44-bc82-fa97f9ab5c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:33.951934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ae73a376-9c27-4a44-bc82-fa97f9ab5c2d None None] MFA Rules not processed for user `c4ec97db9726490aab2d43d20d19dc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:33.953255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ae73a376-9c27-4a44-bc82-fa97f9ab5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:33.969441 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e1485-bada-4641-ac13-935177712115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:33.970335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e1485-bada-4641-ac13-935177712115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:33.970640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e1485-bada-4641-ac13-935177712115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:33.970934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e1485-bada-4641-ac13-935177712115 admin admin] PATH_INFO: `/v3/projects/a2f5d88804e34f4399572543f1674264` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:33.972156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e1485-bada-4641-ac13-935177712115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f5d88804e34f4399572543f1674264)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:33.974113 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e1485-bada-4641-ac13-935177712115 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:34.011847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1251/2488] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:34.048211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:34.057565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-146e1485-bada-4641-ac13-935177712115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f5d88804e34f4399572543f1674264', 'request_id': 'req-146e1485-bada-4641-ac13-935177712115'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:34.063717 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-146e1485-bada-4641-ac13-935177712115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f5d88804e34f4399572543f1674264', 'request_id': 'req-146e1485-bada-4641-ac13-935177712115'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:34.108613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-146e1485-bada-4641-ac13-935177712115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f5d88804e34f4399572543f1674264', 'request_id': 'req-146e1485-bada-4641-ac13-935177712115'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:34.123522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-146e1485-bada-4641-ac13-935177712115 admin admin] The token cache is being invalidate because project a2f5d88804e34f4399572543f1674264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:34.123803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-146e1485-bada-4641-ac13-935177712115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:34.124455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-146e1485-bada-4641-ac13-935177712115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:34.130941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1238/2489] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:33 2022] DELETE /identity/v3/projects/a2f5d88804e34f4399572543f1674264 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:34.131936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d042f7-f393-4f02-be2e-eba5e2c3cf83 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:34.132243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d042f7-f393-4f02-be2e-eba5e2c3cf83 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:34.132673 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d042f7-f393-4f02-be2e-eba5e2c3cf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:34.154955 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d0d042f7-f393-4f02-be2e-eba5e2c3cf83 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:34.156178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d0d042f7-f393-4f02-be2e-eba5e2c3cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:34.221898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1252/2490] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:34.230156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996b99-1b97-458d-8cfd-b7560c3d7c9d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:34.230477 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996b99-1b97-458d-8cfd-b7560c3d7c9d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:34.230760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996b99-1b97-458d-8cfd-b7560c3d7c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:34.249773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-83996b99-1b97-458d-8cfd-b7560c3d7c9d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:34.251128 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-83996b99-1b97-458d-8cfd-b7560c3d7c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:34.259684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1239/2491] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:34.263725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d042f7-f393-4f02-be2e-eba5e2c3cf83 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:34.274769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d042f7-f393-4f02-be2e-eba5e2c3cf83 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:34.279440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445cab8-a0e8-4a1c-bfd4-5de4a4717e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:34.280097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445cab8-a0e8-4a1c-bfd4-5de4a4717e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:34.280383 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445cab8-a0e8-4a1c-bfd4-5de4a4717e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:34.280683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445cab8-a0e8-4a1c-bfd4-5de4a4717e7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:34.281403 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445cab8-a0e8-4a1c-bfd4-5de4a4717e7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:34.281713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445cab8-a0e8-4a1c-bfd4-5de4a4717e7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:34.283368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445cab8-a0e8-4a1c-bfd4-5de4a4717e7d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:34.296184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1253/2492] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:34.300733 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996b99-1b97-458d-8cfd-b7560c3d7c9d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:34.314057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996b99-1b97-458d-8cfd-b7560c3d7c9d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:34.319041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f633d18-d288-4ae9-b7c3-af91c2424f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:34.319753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f633d18-d288-4ae9-b7c3-af91c2424f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:34.320058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f633d18-d288-4ae9-b7c3-af91c2424f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:34.320458 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f633d18-d288-4ae9-b7c3-af91c2424f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:34.321214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f633d18-d288-4ae9-b7c3-af91c2424f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:34.323074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f633d18-d288-4ae9-b7c3-af91c2424f61 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:34.430753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1240/2493] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:34 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:34.435002 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445cab8-a0e8-4a1c-bfd4-5de4a4717e7d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:34.447123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445cab8-a0e8-4a1c-bfd4-5de4a4717e7d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:34.504715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:34.512097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293882c-87de-4f03-a3aa-f09687a5cd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:34.512987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293882c-87de-4f03-a3aa-f09687a5cd58 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:34.513221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293882c-87de-4f03-a3aa-f09687a5cd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:34.513497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293882c-87de-4f03-a3aa-f09687a5cd58 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:34.514203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293882c-87de-4f03-a3aa-f09687a5cd58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:34.516570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293882c-87de-4f03-a3aa-f09687a5cd58 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:34.586901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1254/2494] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:34 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:34.590959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f633d18-d288-4ae9-b7c3-af91c2424f61 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:34.605081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f633d18-d288-4ae9-b7c3-af91c2424f61 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:34.610053 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c45ef-0de9-48f5-9393-9fc3d92cf1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:34.610723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c45ef-0de9-48f5-9393-9fc3d92cf1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:34.611648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c45ef-0de9-48f5-9393-9fc3d92cf1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:34.611648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c45ef-0de9-48f5-9393-9fc3d92cf1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:34.616593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c45ef-0de9-48f5-9393-9fc3d92cf1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:34.616593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c45ef-0de9-48f5-9393-9fc3d92cf1a8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:34.630236 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1241/2495] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:34.632818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293882c-87de-4f03-a3aa-f09687a5cd58 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:34.643528 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293882c-87de-4f03-a3aa-f09687a5cd58 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:34.648790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a1275-10e5-4d4e-a9c6-5b2c08a63193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:34.649453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a1275-10e5-4d4e-a9c6-5b2c08a63193 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:34.649763 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a1275-10e5-4d4e-a9c6-5b2c08a63193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:34.650024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a1275-10e5-4d4e-a9c6-5b2c08a63193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:34.650780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a1275-10e5-4d4e-a9c6-5b2c08a63193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:34.652442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a1275-10e5-4d4e-a9c6-5b2c08a63193 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:34.663048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1255/2496] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:34.667186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c45ef-0de9-48f5-9393-9fc3d92cf1a8 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:34.678571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c45ef-0de9-48f5-9393-9fc3d92cf1a8 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:34.683462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d8385-44fb-468a-90de-c6ee0ca26225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:34.684354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d8385-44fb-468a-90de-c6ee0ca26225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:34.684636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d8385-44fb-468a-90de-c6ee0ca26225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:34.684941 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d8385-44fb-468a-90de-c6ee0ca26225 admin admin] PATH_INFO: `/v3/projects/b1ef27c7681449328073597a88230b61/users/ab7e5d7e8ca94c6396d9c57475a87628/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:34.703504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d8385-44fb-468a-90de-c6ee0ca26225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ef27c7681449328073597a88230b61, user_id=ab7e5d7e8ca94c6396d9c57475a87628, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:34.706884 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d8385-44fb-468a-90de-c6ee0ca26225 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:34.829888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1242/2497] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:34 2022] PUT /identity/v3/projects/b1ef27c7681449328073597a88230b61/users/ab7e5d7e8ca94c6396d9c57475a87628/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:34.840873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d87eb-76a0-42d3-9ddb-cf5fcc6be219 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:34.841810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d87eb-76a0-42d3-9ddb-cf5fcc6be219 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:34.842148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d87eb-76a0-42d3-9ddb-cf5fcc6be219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:34.869220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ee1d87eb-76a0-42d3-9ddb-cf5fcc6be219 None None] MFA Rules not processed for user `ab7e5d7e8ca94c6396d9c57475a87628`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:34.870440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ee1d87eb-76a0-42d3-9ddb-cf5fcc6be219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:34.938149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1256/2498] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:34.949522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d8385-44fb-468a-90de-c6ee0ca26225 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:34.951257 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-819d8385-44fb-468a-90de-c6ee0ca26225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:35.028362 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d8385-44fb-468a-90de-c6ee0ca26225 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:35.034325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78297516-a5ea-4a3f-ac78-1116b3a090d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:35.035011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297516-a5ea-4a3f-ac78-1116b3a090d0 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:35.035301 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297516-a5ea-4a3f-ac78-1116b3a090d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:35.035584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78297516-a5ea-4a3f-ac78-1116b3a090d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:35.044047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78297516-a5ea-4a3f-ac78-1116b3a090d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:35.045655 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78297516-a5ea-4a3f-ac78-1116b3a090d0 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:35.055808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1243/2499] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:35.314319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d87eb-76a0-42d3-9ddb-cf5fcc6be219 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:35.415612 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d87eb-76a0-42d3-9ddb-cf5fcc6be219 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:35.420400 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:35.421306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:35.421592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:35.421869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] PATH_INFO: `/v3/users/ab7e5d7e8ca94c6396d9c57475a87628` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:35.423085 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7e5d7e8ca94c6396d9c57475a87628)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:35.425077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:35.677458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7e5d7e8ca94c6396d9c57475a87628'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:35.691086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7e5d7e8ca94c6396d9c57475a87628'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:35.692838 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:35.806621 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7e5d7e8ca94c6396d9c57475a87628'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:35.807355 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7e5d7e8ca94c6396d9c57475a87628'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:35.815637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7e5d7e8ca94c6396d9c57475a87628'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:35.822436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1257/2500] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:35 2022] DELETE /identity/v3/users/ab7e5d7e8ca94c6396d9c57475a87628 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:35.827303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7cac-28b6-48bc-85ab-cf13aeb67174 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:35.827632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7cac-28b6-48bc-85ab-cf13aeb67174 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:35.828004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d7cac-28b6-48bc-85ab-cf13aeb67174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:35.847654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-020d7cac-28b6-48bc-85ab-cf13aeb67174 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:35.848854 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-020d7cac-28b6-48bc-85ab-cf13aeb67174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:35.906422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:35.923289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1244/2501] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:35.934119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:35.935671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:35.996089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad1b09-848b-4500-b0e8-d5b6b84c88aa admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:35.999877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d0aca-721e-4e03-8ce3-63a0fba867d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:36.000529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d0aca-721e-4e03-8ce3-63a0fba867d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:36.000814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d0aca-721e-4e03-8ce3-63a0fba867d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:36.001094 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d0aca-721e-4e03-8ce3-63a0fba867d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:36.012414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d0aca-721e-4e03-8ce3-63a0fba867d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:36.014227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d0aca-721e-4e03-8ce3-63a0fba867d8 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:36.026682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1258/2502] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:36.513045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7cac-28b6-48bc-85ab-cf13aeb67174 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:36.516037 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-020d7cac-28b6-48bc-85ab-cf13aeb67174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:36.531590 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d7cac-28b6-48bc-85ab-cf13aeb67174 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:36.537952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:36.544666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:36.544666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:36.544666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] PATH_INFO: `/v3/projects/b1ef27c7681449328073597a88230b61` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:36.544666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ef27c7681449328073597a88230b61)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:36.544666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:36.681144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ef27c7681449328073597a88230b61', 'request_id': 'req-9cd452ec-4b67-4eae-bd87-82387a623696'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:36.686700 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ef27c7681449328073597a88230b61', 'request_id': 'req-9cd452ec-4b67-4eae-bd87-82387a623696'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:36.748464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ef27c7681449328073597a88230b61', 'request_id': 'req-9cd452ec-4b67-4eae-bd87-82387a623696'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:36.761183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] The token cache is being invalidate because project b1ef27c7681449328073597a88230b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:36.761387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:36.762023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9cd452ec-4b67-4eae-bd87-82387a623696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:36.763667 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1245/2503] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:36 2022] DELETE /identity/v3/projects/b1ef27c7681449328073597a88230b61 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:36.768899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cad62-60b8-4aa2-9402-c77a7cd5e060 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:36.773458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cad62-60b8-4aa2-9402-c77a7cd5e060 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:36.773458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00cad62-60b8-4aa2-9402-c77a7cd5e060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:36.788823 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c00cad62-60b8-4aa2-9402-c77a7cd5e060 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:36.790015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c00cad62-60b8-4aa2-9402-c77a7cd5e060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:36.856133 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1259/2504] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:36.864184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989207-445d-4cc7-b46f-8cbe1fa488a0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:36.864496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989207-445d-4cc7-b46f-8cbe1fa488a0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:36.864774 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa989207-445d-4cc7-b46f-8cbe1fa488a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:36.883612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fa989207-445d-4cc7-b46f-8cbe1fa488a0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:36.884841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fa989207-445d-4cc7-b46f-8cbe1fa488a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:36.892965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1246/2505] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:36.897879 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cad62-60b8-4aa2-9402-c77a7cd5e060 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:36.907538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00cad62-60b8-4aa2-9402-c77a7cd5e060 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:36.912252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549d1ce-2fee-4734-bef5-074da4e50caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:36.912946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549d1ce-2fee-4734-bef5-074da4e50caf admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:36.913236 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549d1ce-2fee-4734-bef5-074da4e50caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:36.913551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549d1ce-2fee-4734-bef5-074da4e50caf admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:36.914289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549d1ce-2fee-4734-bef5-074da4e50caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:36.914604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549d1ce-2fee-4734-bef5-074da4e50caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:36.916291 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549d1ce-2fee-4734-bef5-074da4e50caf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:36.927975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1260/2506] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:36.932366 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989207-445d-4cc7-b46f-8cbe1fa488a0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:36.941829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa989207-445d-4cc7-b46f-8cbe1fa488a0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:36.947072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dce83d-3470-4857-bf77-03a72302fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:36.947715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dce83d-3470-4857-bf77-03a72302fabe admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:36.948008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dce83d-3470-4857-bf77-03a72302fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:36.948288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dce83d-3470-4857-bf77-03a72302fabe admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:36.949024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dce83d-3470-4857-bf77-03a72302fabe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:36.950945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dce83d-3470-4857-bf77-03a72302fabe admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:37.047068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1247/2507] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:36 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:37.051309 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549d1ce-2fee-4734-bef5-074da4e50caf admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:37.062493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549d1ce-2fee-4734-bef5-074da4e50caf admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:37.124707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48cac-3209-45ba-b60e-e9144cd8c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:37.125380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48cac-3209-45ba-b60e-e9144cd8c7ac admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.125666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48cac-3209-45ba-b60e-e9144cd8c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.125941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d48cac-3209-45ba-b60e-e9144cd8c7ac admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.126643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48cac-3209-45ba-b60e-e9144cd8c7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:37.128630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d48cac-3209-45ba-b60e-e9144cd8c7ac admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:37.215699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1261/2508] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:37 2022] POST /identity/v3/users => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:37.219485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dce83d-3470-4857-bf77-03a72302fabe admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:37.233318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dce83d-3470-4857-bf77-03a72302fabe admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:37.238290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34cc42-8c35-42df-90c3-91c71f21636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:37.239065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34cc42-8c35-42df-90c3-91c71f21636e admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.239416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34cc42-8c35-42df-90c3-91c71f21636e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.242486 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34cc42-8c35-42df-90c3-91c71f21636e admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.242486 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34cc42-8c35-42df-90c3-91c71f21636e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:37.242975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34cc42-8c35-42df-90c3-91c71f21636e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:37.254191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1248/2509] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:37.258440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48cac-3209-45ba-b60e-e9144cd8c7ac admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:37.263611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:37.269319 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d48cac-3209-45ba-b60e-e9144cd8c7ac admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:37.274852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfc4d-3264-475e-8ba9-37c3be9f5164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:37.276890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfc4d-3264-475e-8ba9-37c3be9f5164 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.276890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfc4d-3264-475e-8ba9-37c3be9f5164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.276890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfc4d-3264-475e-8ba9-37c3be9f5164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.276890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdfc4d-3264-475e-8ba9-37c3be9f5164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:37.278420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdfc4d-3264-475e-8ba9-37c3be9f5164 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:37.295652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1262/2510] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:37.296830 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34cc42-8c35-42df-90c3-91c71f21636e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:37.311023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34cc42-8c35-42df-90c3-91c71f21636e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:37.314621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629adc5-c5a4-4a42-94f3-303a8bc44030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:37.315580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629adc5-c5a4-4a42-94f3-303a8bc44030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.315701 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd59e6-2e6a-4f29-b167-1cbc4b3b15a4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.315845 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629adc5-c5a4-4a42-94f3-303a8bc44030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.316123 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629adc5-c5a4-4a42-94f3-303a8bc44030 admin admin] PATH_INFO: `/v3/projects/f447bf0c64f24e389c9289d312c242d1/users/325d57303d8c4e21ae45c3253167fee2/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.316441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd59e6-2e6a-4f29-b167-1cbc4b3b15a4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.316770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd59e6-2e6a-4f29-b167-1cbc4b3b15a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.335554 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629adc5-c5a4-4a42-94f3-303a8bc44030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f447bf0c64f24e389c9289d312c242d1, user_id=325d57303d8c4e21ae45c3253167fee2, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:37.337552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-23fd59e6-2e6a-4f29-b167-1cbc4b3b15a4 None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:37.338781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-23fd59e6-2e6a-4f29-b167-1cbc4b3b15a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:37.338996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629adc5-c5a4-4a42-94f3-303a8bc44030 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:37.397409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1263/2511] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 09:52:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:37.407987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd59e6-2e6a-4f29-b167-1cbc4b3b15a4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:37.409348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-23fd59e6-2e6a-4f29-b167-1cbc4b3b15a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:37.452801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1249/2512] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:37 2022] PUT /identity/v3/projects/f447bf0c64f24e389c9289d312c242d1/users/325d57303d8c4e21ae45c3253167fee2/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:37.463292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0bb71-df21-4b5d-86a2-9f4ddbe9cef6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.463619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0bb71-df21-4b5d-86a2-9f4ddbe9cef6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.463893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0bb71-df21-4b5d-86a2-9f4ddbe9cef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.489855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd59e6-2e6a-4f29-b167-1cbc4b3b15a4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:37.492212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-23c0bb71-df21-4b5d-86a2-9f4ddbe9cef6 None None] MFA Rules not processed for user `325d57303d8c4e21ae45c3253167fee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:37.493407 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-23c0bb71-df21-4b5d-86a2-9f4ddbe9cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:37.551547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfe824-4b59-45c7-b827-d92732715dbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:37.552206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfe824-4b59-45c7-b827-d92732715dbb service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.552493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfe824-4b59-45c7-b827-d92732715dbb service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.553506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfe824-4b59-45c7-b827-d92732715dbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.556600 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:37.560878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1250/2513] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:37.565183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0bb71-df21-4b5d-86a2-9f4ddbe9cef6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:37.601906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:37.619718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfe824-4b59-45c7-b827-d92732715dbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:37.621327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bfe824-4b59-45c7-b827-d92732715dbb service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:37.629896 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1264/2514] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 09:52:37.633838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0bb71-df21-4b5d-86a2-9f4ddbe9cef6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:37.638503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f274a-b02a-4d1c-b91e-45bd9e0023ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:37.639196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f274a-b02a-4d1c-b91e-45bd9e0023ea admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.639488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f274a-b02a-4d1c-b91e-45bd9e0023ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.639763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f274a-b02a-4d1c-b91e-45bd9e0023ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.640715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f274a-b02a-4d1c-b91e-45bd9e0023ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:37.642805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f274a-b02a-4d1c-b91e-45bd9e0023ea admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:37.728418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1251/2515] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:37 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:37.734447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfe824-4b59-45c7-b827-d92732715dbb service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:37.746788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfe824-4b59-45c7-b827-d92732715dbb service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:37.811566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40364fdd-b6ad-4215-b18e-d78810f963ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:37.812199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40364fdd-b6ad-4215-b18e-d78810f963ab admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.813173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40364fdd-b6ad-4215-b18e-d78810f963ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.813803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40364fdd-b6ad-4215-b18e-d78810f963ab admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.814512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40364fdd-b6ad-4215-b18e-d78810f963ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:37.816503 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40364fdd-b6ad-4215-b18e-d78810f963ab admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:37.934336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1265/2516] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:37 2022] POST /identity/v3/users => generated 309 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:37.937922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f274a-b02a-4d1c-b91e-45bd9e0023ea admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:37.960880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f274a-b02a-4d1c-b91e-45bd9e0023ea admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:37.965396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434d1e3-2d59-45d5-95bd-c92a1d953fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:37.966866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d1e3-2d59-45d5-95bd-c92a1d953fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:37.966866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d1e3-2d59-45d5-95bd-c92a1d953fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:37.966866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434d1e3-2d59-45d5-95bd-c92a1d953fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:37.967534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434d1e3-2d59-45d5-95bd-c92a1d953fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:37.969151 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434d1e3-2d59-45d5-95bd-c92a1d953fc3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:37.983484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1252/2517] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:52:37.984871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40364fdd-b6ad-4215-b18e-d78810f963ab admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:37.995538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40364fdd-b6ad-4215-b18e-d78810f963ab admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:38.000539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98b7af-ffdd-40e6-86c0-de7e9a56d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:38.001428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98b7af-ffdd-40e6-86c0-de7e9a56d63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:38.001714 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98b7af-ffdd-40e6-86c0-de7e9a56d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:38.002001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98b7af-ffdd-40e6-86c0-de7e9a56d63f admin admin] PATH_INFO: `/v3/projects/9c301cf66964466489b282d69947de5d/users/b01e38cbf2e745578108537b1b1ed139/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:38.023897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98b7af-ffdd-40e6-86c0-de7e9a56d63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c301cf66964466489b282d69947de5d, user_id=b01e38cbf2e745578108537b1b1ed139, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:38.034788 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98b7af-ffdd-40e6-86c0-de7e9a56d63f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:38.120076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1266/2518] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:37 2022] PUT /identity/v3/projects/9c301cf66964466489b282d69947de5d/users/b01e38cbf2e745578108537b1b1ed139/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:38.122543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434d1e3-2d59-45d5-95bd-c92a1d953fc3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:38.136713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434d1e3-2d59-45d5-95bd-c92a1d953fc3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:38.203055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6a94b-abaa-4f22-9277-4e5ee775d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:38.203839 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6a94b-abaa-4f22-9277-4e5ee775d74b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:38.204124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6a94b-abaa-4f22-9277-4e5ee775d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:38.204403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6a94b-abaa-4f22-9277-4e5ee775d74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:38.205137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6a94b-abaa-4f22-9277-4e5ee775d74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:38.206788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6a94b-abaa-4f22-9277-4e5ee775d74b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:38.233791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1253/2519] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:38.235011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98b7af-ffdd-40e6-86c0-de7e9a56d63f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:38.247059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98b7af-ffdd-40e6-86c0-de7e9a56d63f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:38.253430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e6e49-0a4f-47f0-8b98-26aa2e957013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:38.254341 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e6e49-0a4f-47f0-8b98-26aa2e957013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:38.254627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e6e49-0a4f-47f0-8b98-26aa2e957013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:38.254962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e6e49-0a4f-47f0-8b98-26aa2e957013 admin admin] PATH_INFO: `/v3/projects/9c301cf66964466489b282d69947de5d/users/b01e38cbf2e745578108537b1b1ed139/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:38.257888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e6e49-0a4f-47f0-8b98-26aa2e957013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c301cf66964466489b282d69947de5d, user_id=b01e38cbf2e745578108537b1b1ed139, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:38.260888 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e6e49-0a4f-47f0-8b98-26aa2e957013 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:38.283532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1267/2520] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:38 2022] PUT /identity/v3/projects/9c301cf66964466489b282d69947de5d/users/b01e38cbf2e745578108537b1b1ed139/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:38.296299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b18a5-6010-4439-92d2-37c6ebd0d9d9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:38.296990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b18a5-6010-4439-92d2-37c6ebd0d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:38.297606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b18a5-6010-4439-92d2-37c6ebd0d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:38.342556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d95b18a5-6010-4439-92d2-37c6ebd0d9d9 None None] MFA Rules not processed for user `b01e38cbf2e745578108537b1b1ed139`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:38.345167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d95b18a5-6010-4439-92d2-37c6ebd0d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:38.430581 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:38.446504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1254/2521] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:38.454403 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e6e49-0a4f-47f0-8b98-26aa2e957013 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:38.459918 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-538e6e49-0a4f-47f0-8b98-26aa2e957013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:38.518989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e6e49-0a4f-47f0-8b98-26aa2e957013 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:38.534502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d75c7-bc21-41e2-bbc1-e388e1448758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:38.535571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d75c7-bc21-41e2-bbc1-e388e1448758 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:38.535882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d75c7-bc21-41e2-bbc1-e388e1448758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:38.536138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d75c7-bc21-41e2-bbc1-e388e1448758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:38.547398 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d75c7-bc21-41e2-bbc1-e388e1448758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:38.549035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d75c7-bc21-41e2-bbc1-e388e1448758 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:38.574235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1268/2522] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:38 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:38.727214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b18a5-6010-4439-92d2-37c6ebd0d9d9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:38.799686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b18a5-6010-4439-92d2-37c6ebd0d9d9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:38.806666 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:38.807934 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:38.808408 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:38.808760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] PATH_INFO: `/v3/users/325d57303d8c4e21ae45c3253167fee2` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:38.812072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325d57303d8c4e21ae45c3253167fee2)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:38.815152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:39.039926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325d57303d8c4e21ae45c3253167fee2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:39.041192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325d57303d8c4e21ae45c3253167fee2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:39.060878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325d57303d8c4e21ae45c3253167fee2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:39.070464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325d57303d8c4e21ae45c3253167fee2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:39.181021 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325d57303d8c4e21ae45c3253167fee2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:39.187722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1255/2523] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:38 2022] DELETE /identity/v3/users/325d57303d8c4e21ae45c3253167fee2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:39.192366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d7876-fe9f-4c3e-9355-42b2f3f84a7e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:39.192873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d7876-fe9f-4c3e-9355-42b2f3f84a7e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:39.192972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d7876-fe9f-4c3e-9355-42b2f3f84a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:39.213628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a36d7876-fe9f-4c3e-9355-42b2f3f84a7e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:39.214925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a36d7876-fe9f-4c3e-9355-42b2f3f84a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:39.249253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:39.280219 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1269/2524] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:39.290826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:39.292317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:39.358496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e748f-d09b-432e-8d45-22f8bb45ae55 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:39.362535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f127b-52e7-461f-9242-9117a9eb9193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:39.366935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f127b-52e7-461f-9242-9117a9eb9193 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:39.366935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f127b-52e7-461f-9242-9117a9eb9193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:39.366935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f127b-52e7-461f-9242-9117a9eb9193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:39.373464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f127b-52e7-461f-9242-9117a9eb9193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:39.374917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f127b-52e7-461f-9242-9117a9eb9193 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:39.385828 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1256/2525] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:40.271428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d7876-fe9f-4c3e-9355-42b2f3f84a7e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:40.275651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a36d7876-fe9f-4c3e-9355-42b2f3f84a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:40.302414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d7876-fe9f-4c3e-9355-42b2f3f84a7e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:40.309441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:40.311095 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:40.311733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:40.312022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] PATH_INFO: `/v3/projects/f447bf0c64f24e389c9289d312c242d1` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:40.313746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f447bf0c64f24e389c9289d312c242d1)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:40.315899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:40.491224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f447bf0c64f24e389c9289d312c242d1', 'request_id': 'req-da1fe05e-ec49-403d-b86b-3eb3608b3b20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:40.617698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f447bf0c64f24e389c9289d312c242d1', 'request_id': 'req-da1fe05e-ec49-403d-b86b-3eb3608b3b20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:40.624101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f447bf0c64f24e389c9289d312c242d1', 'request_id': 'req-da1fe05e-ec49-403d-b86b-3eb3608b3b20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:40.636538 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] The token cache is being invalidate because project f447bf0c64f24e389c9289d312c242d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:40.636828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:40.637650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:40.639393 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1270/2526] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:40 2022] DELETE /identity/v3/projects/f447bf0c64f24e389c9289d312c242d1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:40.643571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f127b-52e7-461f-9242-9117a9eb9193 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:40.653752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f127b-52e7-461f-9242-9117a9eb9193 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:40.667529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:40.721234 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:40.722547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:40.722931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:40.723213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] PATH_INFO: `/v3/users/b01e38cbf2e745578108537b1b1ed139` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:40.728157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01e38cbf2e745578108537b1b1ed139)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:40.728157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:40.968125 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01e38cbf2e745578108537b1b1ed139'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:40.968502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01e38cbf2e745578108537b1b1ed139'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:40.991832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01e38cbf2e745578108537b1b1ed139'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:41.003073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01e38cbf2e745578108537b1b1ed139'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:41.063325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4fe3726f-438f-42d9-8c80-d77c0b296dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01e38cbf2e745578108537b1b1ed139'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:41.076091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1257/2527] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:40 2022] DELETE /identity/v3/users/b01e38cbf2e745578108537b1b1ed139 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:41.916040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:41.917697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:41.934380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fe05e-ec49-403d-b86b-3eb3608b3b20 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:41.995304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:41.996168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:41.996455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:41.998191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] PATH_INFO: `/v3/projects/9c301cf66964466489b282d69947de5d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:41.998191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c301cf66964466489b282d69947de5d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:41.999894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:42.132887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c301cf66964466489b282d69947de5d', 'request_id': 'req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:42.194106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c301cf66964466489b282d69947de5d', 'request_id': 'req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:42.198373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:42.200578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c301cf66964466489b282d69947de5d', 'request_id': 'req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:42.211583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] The token cache is being invalidate because project 9c301cf66964466489b282d69947de5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:42.211873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:42.212500 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-15690fb5-1812-4d2b-b61a-fe502a9ec1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:42.214046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1271/2528] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:41 2022] DELETE /identity/v3/projects/9c301cf66964466489b282d69947de5d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:42.218951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cabd7-e994-4718-b50e-6cf03683babb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:42.219431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cabd7-e994-4718-b50e-6cf03683babb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:42.219524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cabd7-e994-4718-b50e-6cf03683babb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:42.238177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f99cabd7-e994-4718-b50e-6cf03683babb None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:42.239425 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f99cabd7-e994-4718-b50e-6cf03683babb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:42.298876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1258/2529] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:42.307316 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f449cd-d29e-4102-86db-9bb25d57c12b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:42.307611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f449cd-d29e-4102-86db-9bb25d57c12b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:42.307894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f449cd-d29e-4102-86db-9bb25d57c12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:42.326184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f8f449cd-d29e-4102-86db-9bb25d57c12b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:42.327457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f8f449cd-d29e-4102-86db-9bb25d57c12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:42.336796 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1272/2530] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:42.340325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cabd7-e994-4718-b50e-6cf03683babb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:42.349916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cabd7-e994-4718-b50e-6cf03683babb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:42.354350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc07ad-a6c4-4023-8a5c-f6c55c2e4baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:42.355030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc07ad-a6c4-4023-8a5c-f6c55c2e4baa admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:42.355314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc07ad-a6c4-4023-8a5c-f6c55c2e4baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:42.355586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc07ad-a6c4-4023-8a5c-f6c55c2e4baa admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:42.356302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc07ad-a6c4-4023-8a5c-f6c55c2e4baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:42.356607 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc07ad-a6c4-4023-8a5c-f6c55c2e4baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:42.358199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc07ad-a6c4-4023-8a5c-f6c55c2e4baa admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:42.369522 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1259/2531] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:42.373543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f449cd-d29e-4102-86db-9bb25d57c12b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:42.383459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f449cd-d29e-4102-86db-9bb25d57c12b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:42.388127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e410c-56f8-477a-8fdf-9e1b9ea83d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:42.388780 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e410c-56f8-477a-8fdf-9e1b9ea83d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:42.389064 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e410c-56f8-477a-8fdf-9e1b9ea83d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:42.389338 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e410c-56f8-477a-8fdf-9e1b9ea83d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:42.390035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e410c-56f8-477a-8fdf-9e1b9ea83d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:42.392215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e410c-56f8-477a-8fdf-9e1b9ea83d05 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:42.515033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1273/2532] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:42 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:42.516411 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc07ad-a6c4-4023-8a5c-f6c55c2e4baa admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:42.538543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc07ad-a6c4-4023-8a5c-f6c55c2e4baa admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:42.561131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:42.610386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d828f8-6fc7-427b-938d-6db4d0bff821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:42.611383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d828f8-6fc7-427b-938d-6db4d0bff821 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:42.611669 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d828f8-6fc7-427b-938d-6db4d0bff821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:42.611945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d828f8-6fc7-427b-938d-6db4d0bff821 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:42.612647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d828f8-6fc7-427b-938d-6db4d0bff821 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:42.614559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d828f8-6fc7-427b-938d-6db4d0bff821 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:42.732688 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1260/2533] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:42 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:42.734068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e410c-56f8-477a-8fdf-9e1b9ea83d05 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:42.746798 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e410c-56f8-477a-8fdf-9e1b9ea83d05 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:42.751952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b3361-8659-4ef9-b2d5-27e3f0f27ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:42.752988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b3361-8659-4ef9-b2d5-27e3f0f27ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:42.752988 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b3361-8659-4ef9-b2d5-27e3f0f27ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:42.753264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b3361-8659-4ef9-b2d5-27e3f0f27ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:42.754010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b3361-8659-4ef9-b2d5-27e3f0f27ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:42.755689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b3361-8659-4ef9-b2d5-27e3f0f27ad6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:42.767889 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1274/2534] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:42.772086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d828f8-6fc7-427b-938d-6db4d0bff821 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:42.782277 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d828f8-6fc7-427b-938d-6db4d0bff821 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:42.787278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98231b9-dd5e-4120-9cd4-e2c262445b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:42.787940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98231b9-dd5e-4120-9cd4-e2c262445b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:42.788226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98231b9-dd5e-4120-9cd4-e2c262445b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:42.788498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98231b9-dd5e-4120-9cd4-e2c262445b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:42.789222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98231b9-dd5e-4120-9cd4-e2c262445b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:42.790823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98231b9-dd5e-4120-9cd4-e2c262445b00 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:42.805821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1261/2535] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:42.806801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b3361-8659-4ef9-b2d5-27e3f0f27ad6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:42.817454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b3361-8659-4ef9-b2d5-27e3f0f27ad6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:42.823245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864b247-1b31-463e-b72f-de2573304be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:42.823883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864b247-1b31-463e-b72f-de2573304be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:42.824336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864b247-1b31-463e-b72f-de2573304be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:42.824682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864b247-1b31-463e-b72f-de2573304be6 admin admin] PATH_INFO: `/v3/projects/5c402e399fc544bcb17ee1c53b8fda00/users/0fd87fff4736470384286d40ce2260d8/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:42.841915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864b247-1b31-463e-b72f-de2573304be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c402e399fc544bcb17ee1c53b8fda00, user_id=0fd87fff4736470384286d40ce2260d8, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:42.844839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864b247-1b31-463e-b72f-de2573304be6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:42.944458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1275/2536] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:42 2022] PUT /identity/v3/projects/5c402e399fc544bcb17ee1c53b8fda00/users/0fd87fff4736470384286d40ce2260d8/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:42.961318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2d20-f298-40c1-afa5-e239f3ee0ed0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:42.961609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2d20-f298-40c1-afa5-e239f3ee0ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:42.961893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2d20-f298-40c1-afa5-e239f3ee0ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:42.992360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-82dc2d20-f298-40c1-afa5-e239f3ee0ed0 None None] MFA Rules not processed for user `0fd87fff4736470384286d40ce2260d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:42.993640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-82dc2d20-f298-40c1-afa5-e239f3ee0ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:43.058928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1262/2537] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:43.063476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864b247-1b31-463e-b72f-de2573304be6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:43.124479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864b247-1b31-463e-b72f-de2573304be6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:43.129148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22fcd9-8033-4fe0-a18b-5da48f2d2ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:43.129839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22fcd9-8033-4fe0-a18b-5da48f2d2ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:43.130113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22fcd9-8033-4fe0-a18b-5da48f2d2ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:43.130389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22fcd9-8033-4fe0-a18b-5da48f2d2ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:43.131117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22fcd9-8033-4fe0-a18b-5da48f2d2ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:43.133015 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22fcd9-8033-4fe0-a18b-5da48f2d2ac5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:43.227655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1276/2538] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:43 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:43.228832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2d20-f298-40c1-afa5-e239f3ee0ed0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:43.239975 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2d20-f298-40c1-afa5-e239f3ee0ed0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:43.298209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a11bf-ddaf-4b76-9cf1-beac1fb09b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:43.298920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a11bf-ddaf-4b76-9cf1-beac1fb09b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:43.299211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a11bf-ddaf-4b76-9cf1-beac1fb09b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:43.299525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a11bf-ddaf-4b76-9cf1-beac1fb09b9e admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:43.300223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a11bf-ddaf-4b76-9cf1-beac1fb09b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:43.302406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a11bf-ddaf-4b76-9cf1-beac1fb09b9e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:43.371541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1263/2539] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:43 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:43.375614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22fcd9-8033-4fe0-a18b-5da48f2d2ac5 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:43.385929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22fcd9-8033-4fe0-a18b-5da48f2d2ac5 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:43.391021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a36e65-732b-4c1d-b9fa-eec6295157b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:43.391678 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a36e65-732b-4c1d-b9fa-eec6295157b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:43.391965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a36e65-732b-4c1d-b9fa-eec6295157b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:43.392244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a36e65-732b-4c1d-b9fa-eec6295157b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:43.392971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a36e65-732b-4c1d-b9fa-eec6295157b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:43.394563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a36e65-732b-4c1d-b9fa-eec6295157b7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:43.405841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1277/2540] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:43.409966 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a11bf-ddaf-4b76-9cf1-beac1fb09b9e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:43.420447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a11bf-ddaf-4b76-9cf1-beac1fb09b9e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:43.425002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad0a4d-d7c4-4e7c-a080-43d6537cf785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:43.425926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad0a4d-d7c4-4e7c-a080-43d6537cf785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:43.426210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad0a4d-d7c4-4e7c-a080-43d6537cf785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:43.426487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad0a4d-d7c4-4e7c-a080-43d6537cf785 admin admin] PATH_INFO: `/v3/projects/356a4438e34a42799efd644bdc648cdc/users/29df5844235d4437802e1e9c55a795f0/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:43.441770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad0a4d-d7c4-4e7c-a080-43d6537cf785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356a4438e34a42799efd644bdc648cdc, user_id=29df5844235d4437802e1e9c55a795f0, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:43.444892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad0a4d-d7c4-4e7c-a080-43d6537cf785 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:43.503244 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:43.510070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1264/2541] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:43 2022] PUT /identity/v3/projects/356a4438e34a42799efd644bdc648cdc/users/29df5844235d4437802e1e9c55a795f0/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:43.515656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a36e65-732b-4c1d-b9fa-eec6295157b7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:43.526583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a36e65-732b-4c1d-b9fa-eec6295157b7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:43.597575 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e145df-ff98-4794-83e7-673cf2334e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:43.598557 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e145df-ff98-4794-83e7-673cf2334e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:43.598941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e145df-ff98-4794-83e7-673cf2334e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:43.599276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e145df-ff98-4794-83e7-673cf2334e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:43.600059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e145df-ff98-4794-83e7-673cf2334e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:43.601740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e145df-ff98-4794-83e7-673cf2334e8c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:43.603157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:43.612385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1278/2542] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:43.617406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad0a4d-d7c4-4e7c-a080-43d6537cf785 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:43.629015 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad0a4d-d7c4-4e7c-a080-43d6537cf785 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:43.634714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f760b4-17ef-4226-a11b-26df9f5beb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:43.635665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f760b4-17ef-4226-a11b-26df9f5beb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:43.635948 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f760b4-17ef-4226-a11b-26df9f5beb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:43.636226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f760b4-17ef-4226-a11b-26df9f5beb99 admin admin] PATH_INFO: `/v3/projects/356a4438e34a42799efd644bdc648cdc/users/29df5844235d4437802e1e9c55a795f0/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:43.638218 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f760b4-17ef-4226-a11b-26df9f5beb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356a4438e34a42799efd644bdc648cdc, user_id=29df5844235d4437802e1e9c55a795f0, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:43.641213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f760b4-17ef-4226-a11b-26df9f5beb99 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:43.652271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1265/2543] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:43 2022] PUT /identity/v3/projects/356a4438e34a42799efd644bdc648cdc/users/29df5844235d4437802e1e9c55a795f0/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:43.664816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a652dd-47fe-4dc0-8dea-7e227e764731 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:43.666136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a652dd-47fe-4dc0-8dea-7e227e764731 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:43.666136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a652dd-47fe-4dc0-8dea-7e227e764731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:43.698820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c0a652dd-47fe-4dc0-8dea-7e227e764731 None None] MFA Rules not processed for user `29df5844235d4437802e1e9c55a795f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:43.698820 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c0a652dd-47fe-4dc0-8dea-7e227e764731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:43.762455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1279/2544] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:43.782496 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f760b4-17ef-4226-a11b-26df9f5beb99 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:43.784197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-55f760b4-17ef-4226-a11b-26df9f5beb99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:43.846520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f760b4-17ef-4226-a11b-26df9f5beb99 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:43.850725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c06b3-bc3b-4150-ace2-43b31e108965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:43.851480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c06b3-bc3b-4150-ace2-43b31e108965 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:43.851862 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c06b3-bc3b-4150-ace2-43b31e108965 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:43.852180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c06b3-bc3b-4150-ace2-43b31e108965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:43.862453 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c06b3-bc3b-4150-ace2-43b31e108965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:43.863686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c06b3-bc3b-4150-ace2-43b31e108965 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:43.875314 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1266/2545] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:44.805306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a652dd-47fe-4dc0-8dea-7e227e764731 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:44.814722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a652dd-47fe-4dc0-8dea-7e227e764731 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:44.823891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71663f-1f87-49cb-8d0c-054322c83199 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29df5844235d4437802e1e9c55a795f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356a4438e34a42799efd644bdc648cdc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:44.823891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71663f-1f87-49cb-8d0c-054322c83199 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:44.823891 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71663f-1f87-49cb-8d0c-054322c83199 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:44.824234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71663f-1f87-49cb-8d0c-054322c83199 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:44.824234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71663f-1f87-49cb-8d0c-054322c83199 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:44.824234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71663f-1f87-49cb-8d0c-054322c83199 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:44.824234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71663f-1f87-49cb-8d0c-054322c83199 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:44.836253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1280/2546] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:44.840533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c06b3-bc3b-4150-ace2-43b31e108965 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:44.850132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c06b3-bc3b-4150-ace2-43b31e108965 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:44.855075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef18b4-9be1-450e-80e3-e5ab6b4b9bdb tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29df5844235d4437802e1e9c55a795f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356a4438e34a42799efd644bdc648cdc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:44.855785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef18b4-9be1-450e-80e3-e5ab6b4b9bdb tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:44.856074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef18b4-9be1-450e-80e3-e5ab6b4b9bdb tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:44.856450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef18b4-9be1-450e-80e3-e5ab6b4b9bdb tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:44.857185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef18b4-9be1-450e-80e3-e5ab6b4b9bdb tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:44.859134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef18b4-9be1-450e-80e3-e5ab6b4b9bdb tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:44.961230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1267/2547] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:44 2022] POST /identity/v3/projects => generated 353 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:44.965335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71663f-1f87-49cb-8d0c-054322c83199 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:44.976273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71663f-1f87-49cb-8d0c-054322c83199 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:45.047221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29df5844235d4437802e1e9c55a795f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356a4438e34a42799efd644bdc648cdc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:45.047909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:45.048205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:45.048590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:45.049426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:45.049745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:45.051399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:45.065066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1281/2548] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:45.114912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef18b4-9be1-450e-80e3-e5ab6b4b9bdb tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:45.127612 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef18b4-9be1-450e-80e3-e5ab6b4b9bdb tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:45.133282 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29df5844235d4437802e1e9c55a795f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '356a4438e34a42799efd644bdc648cdc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:45.134185 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:45.134485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:45.134767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] PATH_INFO: `/v3/projects/793a4e8166104dbd838f191c320116ea` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:45.136423 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Authorizing `identity:delete_project(project_id=793a4e8166104dbd838f191c320116ea)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:45.138406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:45.274008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793a4e8166104dbd838f191c320116ea', 'request_id': 'req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:45.280606 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793a4e8166104dbd838f191c320116ea', 'request_id': 'req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:45.374137 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793a4e8166104dbd838f191c320116ea', 'request_id': 'req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:45.387121 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] The token cache is being invalidate because project 793a4e8166104dbd838f191c320116ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:45.387412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:45.388073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b1330d34-b41d-4720-9e1c-8142d5ddc5d2 tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:45.389626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1268/2549] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:45 2022] DELETE /identity/v3/projects/793a4e8166104dbd838f191c320116ea => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:46.003317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:46.005108 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:46.071499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b90f30-b2de-4f86-b3e7-f0c241177eac tempest-VolumeQuotaClassesTest-1300772236 tempest-VolumeQuotaClassesTest-1300772236-project-admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:46.075982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:46.127728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:46.128611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:46.128903 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:46.129184 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] PATH_INFO: `/v3/users/0fd87fff4736470384286d40ce2260d8` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:46.130391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd87fff4736470384286d40ce2260d8)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:46.133024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:46.289543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd87fff4736470384286d40ce2260d8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:46.304454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd87fff4736470384286d40ce2260d8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:46.348653 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd87fff4736470384286d40ce2260d8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:46.349282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd87fff4736470384286d40ce2260d8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:46.357748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd87fff4736470384286d40ce2260d8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:46.363786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1282/2550] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:46 2022] DELETE /identity/v3/users/0fd87fff4736470384286d40ce2260d8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:46.368935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ba92-b8ab-45fa-8ba6-8c851b82c2a1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:46.369404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ba92-b8ab-45fa-8ba6-8c851b82c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:46.369502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ba92-b8ab-45fa-8ba6-8c851b82c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:46.395478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4446ba92-b8ab-45fa-8ba6-8c851b82c2a1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:46.396856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4446ba92-b8ab-45fa-8ba6-8c851b82c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:46.455382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:46.477031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1269/2551] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:46.486690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:46.488139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:46.554208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e95c6-10a8-4181-890f-7c96b7864107 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:46.558013 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025a08-db29-4573-a4e7-b7c354e50120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:46.558668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025a08-db29-4573-a4e7-b7c354e50120 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:46.558987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025a08-db29-4573-a4e7-b7c354e50120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:46.559270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025a08-db29-4573-a4e7-b7c354e50120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:46.569215 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025a08-db29-4573-a4e7-b7c354e50120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:46.570734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27025a08-db29-4573-a4e7-b7c354e50120 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:46.580359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1283/2552] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:47.019046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446ba92-b8ab-45fa-8ba6-8c851b82c2a1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:47.020490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4446ba92-b8ab-45fa-8ba6-8c851b82c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:47.034402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446ba92-b8ab-45fa-8ba6-8c851b82c2a1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:47.040930 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:47.042195 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:47.042488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:47.043103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] PATH_INFO: `/v3/projects/5c402e399fc544bcb17ee1c53b8fda00` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:47.044892 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c402e399fc544bcb17ee1c53b8fda00)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:47.047519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:47.173757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c402e399fc544bcb17ee1c53b8fda00', 'request_id': 'req-d39e29a4-8218-4e47-bd6b-3716b92adc62'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.180916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c402e399fc544bcb17ee1c53b8fda00', 'request_id': 'req-d39e29a4-8218-4e47-bd6b-3716b92adc62'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.308465 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c402e399fc544bcb17ee1c53b8fda00', 'request_id': 'req-d39e29a4-8218-4e47-bd6b-3716b92adc62'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.323807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] The token cache is being invalidate because project 5c402e399fc544bcb17ee1c53b8fda00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:47.324610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.325497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.327931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1270/2553] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:47 2022] DELETE /identity/v3/projects/5c402e399fc544bcb17ee1c53b8fda00 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:47.331816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025a08-db29-4573-a4e7-b7c354e50120 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:47.347974 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025a08-db29-4573-a4e7-b7c354e50120 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:47.387029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:47.420602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:47.421487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:47.421801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:47.422117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] PATH_INFO: `/v3/users/29df5844235d4437802e1e9c55a795f0` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:47.423634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29df5844235d4437802e1e9c55a795f0)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:47.425380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:47.535886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:47.538081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:47.608043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e29a4-8218-4e47-bd6b-3716b92adc62 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:47.612085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:47.619756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:47.619756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:47.619756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:47.619756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:47.628059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:47.629589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:47.637502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29df5844235d4437802e1e9c55a795f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.639166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1271/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:52:47.653258 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29df5844235d4437802e1e9c55a795f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.730960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29df5844235d4437802e1e9c55a795f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.731598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29df5844235d4437802e1e9c55a795f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.741474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab9d9f65-7cb5-4895-8e9b-2fc42fd600d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29df5844235d4437802e1e9c55a795f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:47.747898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1284/2555] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:47 2022] DELETE /identity/v3/users/29df5844235d4437802e1e9c55a795f0 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:48.262863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:48.262863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:48.299295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8e6d9-efbd-410d-b493-ae72235634e4 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:48.403962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:48.404995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:48.405347 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:48.405684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] PATH_INFO: `/v3/projects/356a4438e34a42799efd644bdc648cdc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:48.407007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=356a4438e34a42799efd644bdc648cdc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:48.409085 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:48.438799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:48.532368 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356a4438e34a42799efd644bdc648cdc', 'request_id': 'req-871e3172-3885-4341-8a9f-55dc274aeafc'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:48.538573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356a4438e34a42799efd644bdc648cdc', 'request_id': 'req-871e3172-3885-4341-8a9f-55dc274aeafc'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:48.656942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356a4438e34a42799efd644bdc648cdc', 'request_id': 'req-871e3172-3885-4341-8a9f-55dc274aeafc'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:48.670078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] The token cache is being invalidate because project 356a4438e34a42799efd644bdc648cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:48.670377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:48.671117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-871e3172-3885-4341-8a9f-55dc274aeafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:48.675870 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1272/2556] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:48 2022] DELETE /identity/v3/projects/356a4438e34a42799efd644bdc648cdc => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:48.680547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728ae9a-8ebb-4673-9aae-bd491b1a33de None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:48.680547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728ae9a-8ebb-4673-9aae-bd491b1a33de None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:48.680547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728ae9a-8ebb-4673-9aae-bd491b1a33de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:48.699789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e728ae9a-8ebb-4673-9aae-bd491b1a33de None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:48.701227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e728ae9a-8ebb-4673-9aae-bd491b1a33de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:48.792209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1285/2557] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:48.792325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0aaf8d-234b-4ce4-8421-2a6655192c2a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:48.792325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0aaf8d-234b-4ce4-8421-2a6655192c2a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:48.792325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0aaf8d-234b-4ce4-8421-2a6655192c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:48.808205 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5b0aaf8d-234b-4ce4-8421-2a6655192c2a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:48.809513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5b0aaf8d-234b-4ce4-8421-2a6655192c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:48.819251 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1273/2558] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:48.823542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728ae9a-8ebb-4673-9aae-bd491b1a33de None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:48.833664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728ae9a-8ebb-4673-9aae-bd491b1a33de None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:48.839358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d2e5d-fcde-46b6-ac51-9f8bc62ba19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:48.840028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2e5d-fcde-46b6-ac51-9f8bc62ba19a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:48.843824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2e5d-fcde-46b6-ac51-9f8bc62ba19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:48.843824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d2e5d-fcde-46b6-ac51-9f8bc62ba19a admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:48.843824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d2e5d-fcde-46b6-ac51-9f8bc62ba19a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:48.843824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d2e5d-fcde-46b6-ac51-9f8bc62ba19a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:48.843824 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d2e5d-fcde-46b6-ac51-9f8bc62ba19a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:48.857439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1286/2559] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:52:48.862369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0aaf8d-234b-4ce4-8421-2a6655192c2a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:48.872686 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0aaf8d-234b-4ce4-8421-2a6655192c2a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:48.877564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e91af-3b42-4c58-9035-4257341795ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:48.878226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e91af-3b42-4c58-9035-4257341795ad admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:48.878510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e91af-3b42-4c58-9035-4257341795ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:48.878788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e91af-3b42-4c58-9035-4257341795ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:48.879528 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e91af-3b42-4c58-9035-4257341795ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:48.882611 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e91af-3b42-4c58-9035-4257341795ad admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:48.996908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1274/2560] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:48 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:48.998493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d2e5d-fcde-46b6-ac51-9f8bc62ba19a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:49.011807 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d2e5d-fcde-46b6-ac51-9f8bc62ba19a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:49.051902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:49.079837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e1a44-a41a-4d41-a806-8c97dec8c20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:49.080522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e1a44-a41a-4d41-a806-8c97dec8c20c admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:49.080811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e1a44-a41a-4d41-a806-8c97dec8c20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:49.081089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e1a44-a41a-4d41-a806-8c97dec8c20c admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:49.081796 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e1a44-a41a-4d41-a806-8c97dec8c20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:49.083916 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e1a44-a41a-4d41-a806-8c97dec8c20c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:49.192119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1287/2561] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:48 2022] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:49.193387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e91af-3b42-4c58-9035-4257341795ad admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:49.205370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e91af-3b42-4c58-9035-4257341795ad admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:49.213819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3da6a3-b7a3-4e93-8fb0-89dadb6118fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:49.213819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da6a3-b7a3-4e93-8fb0-89dadb6118fd admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:49.213819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da6a3-b7a3-4e93-8fb0-89dadb6118fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:49.213819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da6a3-b7a3-4e93-8fb0-89dadb6118fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:49.214744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3da6a3-b7a3-4e93-8fb0-89dadb6118fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:49.215419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3da6a3-b7a3-4e93-8fb0-89dadb6118fd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:49.230724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1275/2562] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:49.231973 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e1a44-a41a-4d41-a806-8c97dec8c20c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:49.250793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e1a44-a41a-4d41-a806-8c97dec8c20c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:49.259592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f140ef-ba32-453c-95fb-e3204006be2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:49.261162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f140ef-ba32-453c-95fb-e3204006be2e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:49.261162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f140ef-ba32-453c-95fb-e3204006be2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:49.261162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f140ef-ba32-453c-95fb-e3204006be2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:49.262752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f140ef-ba32-453c-95fb-e3204006be2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:49.263915 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f140ef-ba32-453c-95fb-e3204006be2e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:49.277362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1288/2563] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:49.283043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3da6a3-b7a3-4e93-8fb0-89dadb6118fd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:49.295186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3da6a3-b7a3-4e93-8fb0-89dadb6118fd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:49.300221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4891f-de2f-4f52-93b9-5c03737bf10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:49.302763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4891f-de2f-4f52-93b9-5c03737bf10f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:49.302763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4891f-de2f-4f52-93b9-5c03737bf10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:49.302763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4891f-de2f-4f52-93b9-5c03737bf10f admin admin] PATH_INFO: `/v3/projects/ffd4437eaaa74473ad13a20002081456/users/e2c48ed114094d5dbf191d70e5c9458d/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:49.325882 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4891f-de2f-4f52-93b9-5c03737bf10f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffd4437eaaa74473ad13a20002081456, user_id=e2c48ed114094d5dbf191d70e5c9458d, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:49.329097 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4891f-de2f-4f52-93b9-5c03737bf10f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:49.431713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1276/2564] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:49 2022] PUT /identity/v3/projects/ffd4437eaaa74473ad13a20002081456/users/e2c48ed114094d5dbf191d70e5c9458d/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:49.442249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92944da-eb66-4b88-9740-26a3c8ce0ebb None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:49.442548 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92944da-eb66-4b88-9740-26a3c8ce0ebb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:49.442835 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92944da-eb66-4b88-9740-26a3c8ce0ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:49.473348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b92944da-eb66-4b88-9740-26a3c8ce0ebb None None] MFA Rules not processed for user `e2c48ed114094d5dbf191d70e5c9458d`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:49.474604 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b92944da-eb66-4b88-9740-26a3c8ce0ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:49.547768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1289/2565] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:49.552105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4891f-de2f-4f52-93b9-5c03737bf10f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:49.639719 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4891f-de2f-4f52-93b9-5c03737bf10f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:49.645967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51973341-7228-498a-925f-73cb6ba808ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:49.647051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51973341-7228-498a-925f-73cb6ba808ae admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:49.647290 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51973341-7228-498a-925f-73cb6ba808ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:49.647568 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51973341-7228-498a-925f-73cb6ba808ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:49.648353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51973341-7228-498a-925f-73cb6ba808ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:49.650365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51973341-7228-498a-925f-73cb6ba808ae admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:49.777330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1277/2566] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:49 2022] POST /identity/v3/projects => generated 381 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:49.778457 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92944da-eb66-4b88-9740-26a3c8ce0ebb None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:49.790389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92944da-eb66-4b88-9740-26a3c8ce0ebb None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:49.867950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045d392-915b-47de-be45-13e5d727aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:49.868551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045d392-915b-47de-be45-13e5d727aa29 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:49.868839 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045d392-915b-47de-be45-13e5d727aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:49.869118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045d392-915b-47de-be45-13e5d727aa29 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:49.869816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045d392-915b-47de-be45-13e5d727aa29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:49.871787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045d392-915b-47de-be45-13e5d727aa29 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:49.937994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1290/2567] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:49 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:52:49.942217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51973341-7228-498a-925f-73cb6ba808ae admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:49.953886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51973341-7228-498a-925f-73cb6ba808ae admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:49.958791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6f3fe-1bca-4119-a195-0863204bbf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:49.959631 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6f3fe-1bca-4119-a195-0863204bbf21 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:49.960442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6f3fe-1bca-4119-a195-0863204bbf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:49.960442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6f3fe-1bca-4119-a195-0863204bbf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:49.961060 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6f3fe-1bca-4119-a195-0863204bbf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:49.962682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6f3fe-1bca-4119-a195-0863204bbf21 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:49.979865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1278/2568] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:52:49.983950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045d392-915b-47de-be45-13e5d727aa29 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:49.995180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045d392-915b-47de-be45-13e5d727aa29 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:50.000053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5dcb2-f695-4c50-b0fb-11d081525f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:50.000948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5dcb2-f695-4c50-b0fb-11d081525f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:50.001235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5dcb2-f695-4c50-b0fb-11d081525f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:50.001634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5dcb2-f695-4c50-b0fb-11d081525f5e admin admin] PATH_INFO: `/v3/projects/0c96c1f14bf24948b3179cd5a14e56f3/users/7d6fe7d4f6124bdabfc3c8e56a957252/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:50.017502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5dcb2-f695-4c50-b0fb-11d081525f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c96c1f14bf24948b3179cd5a14e56f3, user_id=7d6fe7d4f6124bdabfc3c8e56a957252, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:50.020226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5dcb2-f695-4c50-b0fb-11d081525f5e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:50.091594 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1291/2569] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:49 2022] PUT /identity/v3/projects/0c96c1f14bf24948b3179cd5a14e56f3/users/7d6fe7d4f6124bdabfc3c8e56a957252/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:50.095632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6f3fe-1bca-4119-a195-0863204bbf21 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:50.106543 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6f3fe-1bca-4119-a195-0863204bbf21 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:50.128988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:50.182971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b7cb6-9eae-4d71-aead-c53bf1e3db31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:50.184806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7cb6-9eae-4d71-aead-c53bf1e3db31 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:50.184806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7cb6-9eae-4d71-aead-c53bf1e3db31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:50.184806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b7cb6-9eae-4d71-aead-c53bf1e3db31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:50.185091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7cb6-9eae-4d71-aead-c53bf1e3db31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:50.186574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b7cb6-9eae-4d71-aead-c53bf1e3db31 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:50.197451 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1279/2570] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:50.201625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5dcb2-f695-4c50-b0fb-11d081525f5e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:50.212152 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5dcb2-f695-4c50-b0fb-11d081525f5e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:50.216952 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbfd73-e11f-45fc-9e91-b899b45072ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:50.217845 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbfd73-e11f-45fc-9e91-b899b45072ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:50.218134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbfd73-e11f-45fc-9e91-b899b45072ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:50.218410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbfd73-e11f-45fc-9e91-b899b45072ab admin admin] PATH_INFO: `/v3/projects/0c96c1f14bf24948b3179cd5a14e56f3/users/7d6fe7d4f6124bdabfc3c8e56a957252/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:50.220445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbfd73-e11f-45fc-9e91-b899b45072ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c96c1f14bf24948b3179cd5a14e56f3, user_id=7d6fe7d4f6124bdabfc3c8e56a957252, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:50.223181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccbfd73-e11f-45fc-9e91-b899b45072ab admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:50.229661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:50.234999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1292/2571] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:50 2022] PUT /identity/v3/projects/0c96c1f14bf24948b3179cd5a14e56f3/users/7d6fe7d4f6124bdabfc3c8e56a957252/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:50.247199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ffa55-08b8-4ef3-acfb-0a1a90e43f48 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:50.247579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ffa55-08b8-4ef3-acfb-0a1a90e43f48 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:50.247876 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ffa55-08b8-4ef3-acfb-0a1a90e43f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:50.276317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ca0ffa55-08b8-4ef3-acfb-0a1a90e43f48 None None] MFA Rules not processed for user `7d6fe7d4f6124bdabfc3c8e56a957252`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:50.277529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ca0ffa55-08b8-4ef3-acfb-0a1a90e43f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:50.345869 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1280/2572] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:50.358270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbfd73-e11f-45fc-9e91-b899b45072ab admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:50.360025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eccbfd73-e11f-45fc-9e91-b899b45072ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:50.420281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccbfd73-e11f-45fc-9e91-b899b45072ab admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:50.424023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6cc75-3af7-49ba-8fcf-4a034ffe19a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:50.424680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6cc75-3af7-49ba-8fcf-4a034ffe19a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:50.424960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6cc75-3af7-49ba-8fcf-4a034ffe19a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:50.425242 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6cc75-3af7-49ba-8fcf-4a034ffe19a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:50.435023 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6cc75-3af7-49ba-8fcf-4a034ffe19a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:50.438999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6cc75-3af7-49ba-8fcf-4a034ffe19a1 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:50.448470 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1293/2573] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:50.619577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ffa55-08b8-4ef3-acfb-0a1a90e43f48 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:50.629718 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ffa55-08b8-4ef3-acfb-0a1a90e43f48 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:50.634309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93c1d1-cbd5-4a7a-8f09-2dc1b49622db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:50.635093 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93c1d1-cbd5-4a7a-8f09-2dc1b49622db service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:50.639038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93c1d1-cbd5-4a7a-8f09-2dc1b49622db service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:50.639350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93c1d1-cbd5-4a7a-8f09-2dc1b49622db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:50.702756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93c1d1-cbd5-4a7a-8f09-2dc1b49622db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:50.704287 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93c1d1-cbd5-4a7a-8f09-2dc1b49622db service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:50.714142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1281/2574] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:51.175247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6cc75-3af7-49ba-8fcf-4a034ffe19a1 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:51.242181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6cc75-3af7-49ba-8fcf-4a034ffe19a1 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:51.247393 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:51.248277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:51.248718 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:51.249008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] PATH_INFO: `/v3/users/e2c48ed114094d5dbf191d70e5c9458d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:51.250210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c48ed114094d5dbf191d70e5c9458d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:51.252238 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:51.417506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c48ed114094d5dbf191d70e5c9458d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:51.432592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c48ed114094d5dbf191d70e5c9458d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:51.542828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c48ed114094d5dbf191d70e5c9458d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:51.543751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c48ed114094d5dbf191d70e5c9458d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:51.552634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c48ed114094d5dbf191d70e5c9458d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:51.559520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1294/2575] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:51 2022] DELETE /identity/v3/users/e2c48ed114094d5dbf191d70e5c9458d => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:51.564769 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612abc7a-5a31-4c05-b17b-1836543ccd28 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:51.565062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612abc7a-5a31-4c05-b17b-1836543ccd28 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:51.565344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612abc7a-5a31-4c05-b17b-1836543ccd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:51.585274 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-612abc7a-5a31-4c05-b17b-1836543ccd28 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:51.586537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-612abc7a-5a31-4c05-b17b-1836543ccd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:51.619569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:51.649597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1282/2576] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:51.660017 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:51.661428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:51.691169 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:51.738281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88adcbdd-f9f8-441b-922e-dc16057b848a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:51.743504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5262a38-d896-4907-a094-f97804772aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:51.744251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5262a38-d896-4907-a094-f97804772aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:51.744672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5262a38-d896-4907-a094-f97804772aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:51.745035 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5262a38-d896-4907-a094-f97804772aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:51.755160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5262a38-d896-4907-a094-f97804772aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:51.756863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5262a38-d896-4907-a094-f97804772aa9 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:51.768049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1295/2577] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:52:52.299108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612abc7a-5a31-4c05-b17b-1836543ccd28 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:52.300577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-612abc7a-5a31-4c05-b17b-1836543ccd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:52.312952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612abc7a-5a31-4c05-b17b-1836543ccd28 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:52.318229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:52.321822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:52.321822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:52.321822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] PATH_INFO: `/v3/projects/ffd4437eaaa74473ad13a20002081456` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:52.321822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffd4437eaaa74473ad13a20002081456)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:52.323081 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:52.445036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffd4437eaaa74473ad13a20002081456', 'request_id': 'req-037ed63b-92b0-4859-bdc0-a5fa05265f3c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.451626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffd4437eaaa74473ad13a20002081456', 'request_id': 'req-037ed63b-92b0-4859-bdc0-a5fa05265f3c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.531367 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffd4437eaaa74473ad13a20002081456', 'request_id': 'req-037ed63b-92b0-4859-bdc0-a5fa05265f3c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.544627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] The token cache is being invalidate because project ffd4437eaaa74473ad13a20002081456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:52.544915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.545562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.548891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1283/2578] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:52 2022] DELETE /identity/v3/projects/ffd4437eaaa74473ad13a20002081456 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:52.553228 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5262a38-d896-4907-a094-f97804772aa9 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:52.563008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5262a38-d896-4907-a094-f97804772aa9 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:52.621529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:52.622459 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:52.622736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:52.623074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] PATH_INFO: `/v3/users/7d6fe7d4f6124bdabfc3c8e56a957252` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:52.624251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d6fe7d4f6124bdabfc3c8e56a957252)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:52.626187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:52.763209 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d6fe7d4f6124bdabfc3c8e56a957252'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.777107 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d6fe7d4f6124bdabfc3c8e56a957252'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.833830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d6fe7d4f6124bdabfc3c8e56a957252'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.835106 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d6fe7d4f6124bdabfc3c8e56a957252'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.843307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b487a07f-fadf-43d9-baec-1a1da937f097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d6fe7d4f6124bdabfc3c8e56a957252'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:52.850697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1296/2579] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:52 2022] DELETE /identity/v3/users/7d6fe7d4f6124bdabfc3c8e56a957252 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:53.293384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:53.294986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:53.310715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ed63b-92b0-4859-bdc0-a5fa05265f3c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:53.379617 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:53.380478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:53.381292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:53.381574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] PATH_INFO: `/v3/projects/0c96c1f14bf24948b3179cd5a14e56f3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:53.382773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c96c1f14bf24948b3179cd5a14e56f3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:53.384761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:53.417841 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690c99-6f98-44c8-8705-f4525bd4b6e7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:53.418142 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690c99-6f98-44c8-8705-f4525bd4b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:53.418413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b690c99-6f98-44c8-8705-f4525bd4b6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:53.436260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6b690c99-6f98-44c8-8705-f4525bd4b6e7 None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:53.437569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6b690c99-6f98-44c8-8705-f4525bd4b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:53.487906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:53.502302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c96c1f14bf24948b3179cd5a14e56f3', 'request_id': 'req-6675643e-e9d8-47f7-8883-2c3091e89bee'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:53.508453 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c96c1f14bf24948b3179cd5a14e56f3', 'request_id': 'req-6675643e-e9d8-47f7-8883-2c3091e89bee'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:53.508626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1297/2580] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:53.511595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:53.526399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690c99-6f98-44c8-8705-f4525bd4b6e7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:53.526399 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6b690c99-6f98-44c8-8705-f4525bd4b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:53.577376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c96c1f14bf24948b3179cd5a14e56f3', 'request_id': 'req-6675643e-e9d8-47f7-8883-2c3091e89bee'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:53.593638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] The token cache is being invalidate because project 0c96c1f14bf24948b3179cd5a14e56f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:52:53.593945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:53.594980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6675643e-e9d8-47f7-8883-2c3091e89bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:53.596511 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1284/2581] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:53 2022] DELETE /identity/v3/projects/0c96c1f14bf24948b3179cd5a14e56f3 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:53.605443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d36bf-1ad7-421d-b70e-f914259c5005 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:53.605443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d36bf-1ad7-421d-b70e-f914259c5005 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:53.605443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d36bf-1ad7-421d-b70e-f914259c5005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:53.617613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b690c99-6f98-44c8-8705-f4525bd4b6e7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:53.623094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2b4d36bf-1ad7-421d-b70e-f914259c5005 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:53.624382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2b4d36bf-1ad7-421d-b70e-f914259c5005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:53.673622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97f61-c0c7-4aa0-8b52-f410c8d4e755 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:53.674275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97f61-c0c7-4aa0-8b52-f410c8d4e755 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:53.674558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97f61-c0c7-4aa0-8b52-f410c8d4e755 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:53.674833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97f61-c0c7-4aa0-8b52-f410c8d4e755 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:53.676717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-20b97f61-c0c7-4aa0-8b52-f410c8d4e755 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:53.688329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1285/2582] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:53.696250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df7972-4111-489b-94b6-1c4637ab10e1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:53.697904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df7972-4111-489b-94b6-1c4637ab10e1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:53.697904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df7972-4111-489b-94b6-1c4637ab10e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:53.714921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-75df7972-4111-489b-94b6-1c4637ab10e1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:53.716135 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-75df7972-4111-489b-94b6-1c4637ab10e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:53.724569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1286/2583] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:52:53.728812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df7972-4111-489b-94b6-1c4637ab10e1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:53.736281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b97f61-c0c7-4aa0-8b52-f410c8d4e755 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:53.737894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b97f61-c0c7-4aa0-8b52-f410c8d4e755 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:53.738161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df7972-4111-489b-94b6-1c4637ab10e1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:53.743000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a03e5a-d7ca-48a1-b2af-ca84c5b1124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:53.743639 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a03e5a-d7ca-48a1-b2af-ca84c5b1124a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:53.743920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a03e5a-d7ca-48a1-b2af-ca84c5b1124a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:53.744194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a03e5a-d7ca-48a1-b2af-ca84c5b1124a admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:53.744906 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a03e5a-d7ca-48a1-b2af-ca84c5b1124a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:52:53.745214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a03e5a-d7ca-48a1-b2af-ca84c5b1124a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:53.746337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1298/2584] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:52:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:52:53.746825 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a03e5a-d7ca-48a1-b2af-ca84c5b1124a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:53.762424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1287/2585] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:52:53.763789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97f61-c0c7-4aa0-8b52-f410c8d4e755 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:53.775009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97f61-c0c7-4aa0-8b52-f410c8d4e755 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:53.779655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf9756-f7fd-420a-b34e-84594cf05f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:53.780320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf9756-f7fd-420a-b34e-84594cf05f27 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:53.780622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf9756-f7fd-420a-b34e-84594cf05f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:53.780904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf9756-f7fd-420a-b34e-84594cf05f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:53.781636 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf9756-f7fd-420a-b34e-84594cf05f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:53.783560 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf9756-f7fd-420a-b34e-84594cf05f27 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:53.870771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1299/2586] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:52:53 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:53.875263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a03e5a-d7ca-48a1-b2af-ca84c5b1124a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:53.886333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a03e5a-d7ca-48a1-b2af-ca84c5b1124a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:53.946676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333c615-a612-4e71-83ec-fbfffe3b34cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:53.947636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333c615-a612-4e71-83ec-fbfffe3b34cb admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:53.948174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333c615-a612-4e71-83ec-fbfffe3b34cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:53.948472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333c615-a612-4e71-83ec-fbfffe3b34cb admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:53.950190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333c615-a612-4e71-83ec-fbfffe3b34cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:53.952204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333c615-a612-4e71-83ec-fbfffe3b34cb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:54.103174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1288/2587] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:52:53 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:52:54.107884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf9756-f7fd-420a-b34e-84594cf05f27 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:54.119440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf9756-f7fd-420a-b34e-84594cf05f27 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:54.124476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e03736-27a4-434e-8b45-4f541a93671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:54.128043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e03736-27a4-434e-8b45-4f541a93671e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:54.128043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e03736-27a4-434e-8b45-4f541a93671e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:54.128043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e03736-27a4-434e-8b45-4f541a93671e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:54.128043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e03736-27a4-434e-8b45-4f541a93671e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:54.128043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e03736-27a4-434e-8b45-4f541a93671e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:54.130453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:54.143930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1300/2588] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:52:54.145335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333c615-a612-4e71-83ec-fbfffe3b34cb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:54.156255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333c615-a612-4e71-83ec-fbfffe3b34cb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:54.161485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fdddd-806f-474b-8bce-48692550b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:54.163000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fdddd-806f-474b-8bce-48692550b8ca admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:54.163263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fdddd-806f-474b-8bce-48692550b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:54.163634 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fdddd-806f-474b-8bce-48692550b8ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:54.164456 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fdddd-806f-474b-8bce-48692550b8ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:54.166091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fdddd-806f-474b-8bce-48692550b8ca admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:54.176967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1289/2589] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:52:54.182045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e03736-27a4-434e-8b45-4f541a93671e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:54.192248 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e03736-27a4-434e-8b45-4f541a93671e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:54.197127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30197932-c641-4d61-84c2-d58bcb5839c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:54.198010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30197932-c641-4d61-84c2-d58bcb5839c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:54.198297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30197932-c641-4d61-84c2-d58bcb5839c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:54.198579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30197932-c641-4d61-84c2-d58bcb5839c0 admin admin] PATH_INFO: `/v3/projects/aa49a0fea77b431b969f0a9573f74319/users/ffbc8eb88c1d40888a835035ec151887/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:54.214114 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30197932-c641-4d61-84c2-d58bcb5839c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa49a0fea77b431b969f0a9573f74319, user_id=ffbc8eb88c1d40888a835035ec151887, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:54.217007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30197932-c641-4d61-84c2-d58bcb5839c0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:54.315245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1301/2590] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:52:54 2022] PUT /identity/v3/projects/aa49a0fea77b431b969f0a9573f74319/users/ffbc8eb88c1d40888a835035ec151887/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:54.327481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f544-5870-4b8a-b3b7-e4a60facb8ee None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:54.327888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f544-5870-4b8a-b3b7-e4a60facb8ee None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:54.328096 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f544-5870-4b8a-b3b7-e4a60facb8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:54.357596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1780f544-5870-4b8a-b3b7-e4a60facb8ee None None] MFA Rules not processed for user `ffbc8eb88c1d40888a835035ec151887`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:54.357693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1780f544-5870-4b8a-b3b7-e4a60facb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:54.404595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:54.431252 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1290/2591] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:54.442609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30197932-c641-4d61-84c2-d58bcb5839c0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:54.445178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-30197932-c641-4d61-84c2-d58bcb5839c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:54.512752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30197932-c641-4d61-84c2-d58bcb5839c0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:54.516844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f0d7d-e369-4f2b-9824-6d296d2708c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:54.517633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0d7d-e369-4f2b-9824-6d296d2708c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:54.518014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0d7d-e369-4f2b-9824-6d296d2708c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:54.518484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0d7d-e369-4f2b-9824-6d296d2708c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:54.528811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f0d7d-e369-4f2b-9824-6d296d2708c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:54.530325 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f0d7d-e369-4f2b-9824-6d296d2708c4 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:54.540145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1302/2592] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:54.683927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b69fb-8a5d-4a74-ab4f-54d27fe43b7a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:54.684221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b69fb-8a5d-4a74-ab4f-54d27fe43b7a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:54.684500 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b69fb-8a5d-4a74-ab4f-54d27fe43b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:54.704820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d02b69fb-8a5d-4a74-ab4f-54d27fe43b7a None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:54.706032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d02b69fb-8a5d-4a74-ab4f-54d27fe43b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:54.764243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1291/2593] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 09:52:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:54.776804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f0d7d-e369-4f2b-9824-6d296d2708c4 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:54.778247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d17f0d7d-e369-4f2b-9824-6d296d2708c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:54.849078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f0d7d-e369-4f2b-9824-6d296d2708c4 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:54.858999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81002a33-94fb-4077-bbdf-f398de08162e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:54.858999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81002a33-94fb-4077-bbdf-f398de08162e service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:54.858999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81002a33-94fb-4077-bbdf-f398de08162e service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:54.858999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81002a33-94fb-4077-bbdf-f398de08162e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:54.863734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81002a33-94fb-4077-bbdf-f398de08162e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:54.866093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81002a33-94fb-4077-bbdf-f398de08162e service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:54.874613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1303/2594] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:52:54.960748 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b69fb-8a5d-4a74-ab4f-54d27fe43b7a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:54.962156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d02b69fb-8a5d-4a74-ab4f-54d27fe43b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:55.023503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b69fb-8a5d-4a74-ab4f-54d27fe43b7a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:55.027370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaebb2-087a-44cb-9c53-cd166c218c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:55.028041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaebb2-087a-44cb-9c53-cd166c218c5c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:55.028322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaebb2-087a-44cb-9c53-cd166c218c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:55.028596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaebb2-087a-44cb-9c53-cd166c218c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:55.030337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cdaaebb2-087a-44cb-9c53-cd166c218c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:55.096498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaebb2-087a-44cb-9c53-cd166c218c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:55.098031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaebb2-087a-44cb-9c53-cd166c218c5c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:55.108162 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1292/2595] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:52:55.510925 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46fa4c-45c9-4918-acc0-5bcc33219191 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:55.511296 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46fa4c-45c9-4918-acc0-5bcc33219191 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:55.511647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46fa4c-45c9-4918-acc0-5bcc33219191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:55.530048 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2b46fa4c-45c9-4918-acc0-5bcc33219191 None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:55.531435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2b46fa4c-45c9-4918-acc0-5bcc33219191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:55.539027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1304/2596] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:52:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:55.551426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaebb2-087a-44cb-9c53-cd166c218c5c service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:55.571033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaebb2-087a-44cb-9c53-cd166c218c5c service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:55.576436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68f147-cab4-423e-9030-276a370bb570 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:55.579044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68f147-cab4-423e-9030-276a370bb570 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:55.579044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68f147-cab4-423e-9030-276a370bb570 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:55.579044 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68f147-cab4-423e-9030-276a370bb570 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:55.586735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68f147-cab4-423e-9030-276a370bb570 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:55.588406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da68f147-cab4-423e-9030-276a370bb570 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:55.602712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1293/2597] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:52:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:52:56.294942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eda40-4545-4bec-94ad-5ffcb382c5dc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:56.294942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eda40-4545-4bec-94ad-5ffcb382c5dc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:56.294942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eda40-4545-4bec-94ad-5ffcb382c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:56.319655 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f05eda40-4545-4bec-94ad-5ffcb382c5dc None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:56.321269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f05eda40-4545-4bec-94ad-5ffcb382c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:56.331397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1305/2598] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 09:52:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:56.358753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68f147-cab4-423e-9030-276a370bb570 service swift] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:56.360294 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68f147-cab4-423e-9030-276a370bb570 service swift] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:56.371765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62056cb7-9605-44ee-9479-1116fe4826ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:56.372560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62056cb7-9605-44ee-9479-1116fe4826ca service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:56.372942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62056cb7-9605-44ee-9479-1116fe4826ca service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:56.373346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62056cb7-9605-44ee-9479-1116fe4826ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:56.384558 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62056cb7-9605-44ee-9479-1116fe4826ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:56.386332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62056cb7-9605-44ee-9479-1116fe4826ca service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:56.402480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1294/2599] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:52:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:52:59.082350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eda40-4545-4bec-94ad-5ffcb382c5dc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:59.085485 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f05eda40-4545-4bec-94ad-5ffcb382c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:59.105537 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eda40-4545-4bec-94ad-5ffcb382c5dc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:59.110093 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:59.111009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:59.111299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:59.111578 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] PATH_INFO: `/v3/users/cbb22c3df9e9452db19974f52d3ebb17` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:59.112975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbb22c3df9e9452db19974f52d3ebb17)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:59.115216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:59.315950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbb22c3df9e9452db19974f52d3ebb17'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.317235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:59.331740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbb22c3df9e9452db19974f52d3ebb17'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.335311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62056cb7-9605-44ee-9479-1116fe4826ca service swift] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:59.340150 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-62056cb7-9605-44ee-9479-1116fe4826ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:59.350728 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62056cb7-9605-44ee-9479-1116fe4826ca service swift] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:59.355599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:59.356642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:59.356998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:59.357292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] PATH_INFO: `/v3/users/c4ec97db9726490aab2d43d20d19dc6a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:59.358807 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ec97db9726490aab2d43d20d19dc6a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:59.361305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:59.363306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:52:59.411066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbb22c3df9e9452db19974f52d3ebb17'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.411640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbb22c3df9e9452db19974f52d3ebb17'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.419566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbb22c3df9e9452db19974f52d3ebb17'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.425481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1306/2600] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:59 2022] DELETE /identity/v3/users/cbb22c3df9e9452db19974f52d3ebb17 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:52:59.592306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ec97db9726490aab2d43d20d19dc6a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.592988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ec97db9726490aab2d43d20d19dc6a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.605318 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ec97db9726490aab2d43d20d19dc6a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.612074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ec97db9726490aab2d43d20d19dc6a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.702415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d8a4d536-0179-450c-9039-d00fed598526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ec97db9726490aab2d43d20d19dc6a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:52:59.710508 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1295/2601] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:52:59 2022] DELETE /identity/v3/users/c4ec97db9726490aab2d43d20d19dc6a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:52:59.710659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:59.712463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:59.714086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5866010-90f1-4092-88bc-e64dd03aab82 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:59.714378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5866010-90f1-4092-88bc-e64dd03aab82 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:59.714656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5866010-90f1-4092-88bc-e64dd03aab82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:59.736281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b5866010-90f1-4092-88bc-e64dd03aab82 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:52:59.739444 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b5866010-90f1-4092-88bc-e64dd03aab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:59.781934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b4987-1394-42d0-8ce4-e4e39bffb1bc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:59.806051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1296/2602] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:52:59.816321 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5866010-90f1-4092-88bc-e64dd03aab82 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:52:59.817704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b5866010-90f1-4092-88bc-e64dd03aab82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:52:59.848831 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:59.850164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:59.850550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:59.851025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] PATH_INFO: `/v3/projects/e81b69506d8c4faeb7ae3f537657a673` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:59.852577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81b69506d8c4faeb7ae3f537657a673)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:59.854771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:59.890758 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5866010-90f1-4092-88bc-e64dd03aab82 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:52:59.894775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c1a63-e4e5-4eaa-b715-ff6ef4ebf0b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:52:59.895337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c1a63-e4e5-4eaa-b715-ff6ef4ebf0b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:52:59.895687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c1a63-e4e5-4eaa-b715-ff6ef4ebf0b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:52:59.896030 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c1a63-e4e5-4eaa-b715-ff6ef4ebf0b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:52:59.905991 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c1a63-e4e5-4eaa-b715-ff6ef4ebf0b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:52:59.907474 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c1a63-e4e5-4eaa-b715-ff6ef4ebf0b5 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:52:59.920177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1297/2603] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:52:59.979665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81b69506d8c4faeb7ae3f537657a673', 'request_id': 'req-0e587b51-21dc-4839-841a-4ef3dade47b8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.044784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81b69506d8c4faeb7ae3f537657a673', 'request_id': 'req-0e587b51-21dc-4839-841a-4ef3dade47b8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.051147 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81b69506d8c4faeb7ae3f537657a673', 'request_id': 'req-0e587b51-21dc-4839-841a-4ef3dade47b8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.064276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] The token cache is being invalidate because project e81b69506d8c4faeb7ae3f537657a673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:00.064966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.065223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0e587b51-21dc-4839-841a-4ef3dade47b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.072171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1307/2604] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:52:59 2022] DELETE /identity/v3/projects/e81b69506d8c4faeb7ae3f537657a673 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:53:00.073873 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd8d15-ffbd-4a42-8d76-259fde1225c6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.074145 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd8d15-ffbd-4a42-8d76-259fde1225c6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.074536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd8d15-ffbd-4a42-8d76-259fde1225c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:00.094927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4edd8d15-ffbd-4a42-8d76-259fde1225c6 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:00.098406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4edd8d15-ffbd-4a42-8d76-259fde1225c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:00.117311 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:00.161067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1298/2605] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:00.170730 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8ff3c-ccf2-4df1-9f47-aa0d3c81d4bc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.171313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8ff3c-ccf2-4df1-9f47-aa0d3c81d4bc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.171433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8ff3c-ccf2-4df1-9f47-aa0d3c81d4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:00.179063 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:00.192078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd8d15-ffbd-4a42-8d76-259fde1225c6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:00.192078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4edd8d15-ffbd-4a42-8d76-259fde1225c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:00.196571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ddf8ff3c-ccf2-4df1-9f47-aa0d3c81d4bc None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:00.197813 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ddf8ff3c-ccf2-4df1-9f47-aa0d3c81d4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:00.205050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd8d15-ffbd-4a42-8d76-259fde1225c6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:00.212183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:00.213178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.213400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.213672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] PATH_INFO: `/v3/projects/39a73090edaf41999559912e6927bb3f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:00.215007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a73090edaf41999559912e6927bb3f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:00.221063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:00.226489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1308/2606] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:00.236145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8ff3c-ccf2-4df1-9f47-aa0d3c81d4bc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:00.249176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf8ff3c-ccf2-4df1-9f47-aa0d3c81d4bc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:00.254880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0beb00-7d20-463f-b408-b39aeb2a8a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:00.256420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0beb00-7d20-463f-b408-b39aeb2a8a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.256809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0beb00-7d20-463f-b408-b39aeb2a8a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.257171 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0beb00-7d20-463f-b408-b39aeb2a8a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:00.257989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0beb00-7d20-463f-b408-b39aeb2a8a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:53:00.258389 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0beb00-7d20-463f-b408-b39aeb2a8a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:00.260149 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0beb00-7d20-463f-b408-b39aeb2a8a9e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:00.276929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1309/2607] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:53:00.278082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0beb00-7d20-463f-b408-b39aeb2a8a9e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:00.289413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0beb00-7d20-463f-b408-b39aeb2a8a9e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:00.299724 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d2949-66eb-4583-b14c-732c6290f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:00.306881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d2949-66eb-4583-b14c-732c6290f4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.306881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d2949-66eb-4583-b14c-732c6290f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.306881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d2949-66eb-4583-b14c-732c6290f4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:00.306881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d2949-66eb-4583-b14c-732c6290f4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:00.306881 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d2949-66eb-4583-b14c-732c6290f4a2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:00.345714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a73090edaf41999559912e6927bb3f', 'request_id': 'req-8ff9b238-b66c-45e4-83f5-434c9a9b0608'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.352111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a73090edaf41999559912e6927bb3f', 'request_id': 'req-8ff9b238-b66c-45e4-83f5-434c9a9b0608'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.397637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1310/2608] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:00 2022] POST /identity/v3/projects => generated 355 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:00.402448 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d2949-66eb-4583-b14c-732c6290f4a2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:00.457459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a73090edaf41999559912e6927bb3f', 'request_id': 'req-8ff9b238-b66c-45e4-83f5-434c9a9b0608'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.476109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] The token cache is being invalidate because project 39a73090edaf41999559912e6927bb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:00.477506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.479443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:00.497556 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1299/2609] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:00 2022] DELETE /identity/v3/projects/39a73090edaf41999559912e6927bb3f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:00.532037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d2949-66eb-4583-b14c-732c6290f4a2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:00.550943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c820-5ea9-48dc-abcd-bacfdce54a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:00.550943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c820-5ea9-48dc-abcd-bacfdce54a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.550943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c820-5ea9-48dc-abcd-bacfdce54a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.550943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53c820-5ea9-48dc-abcd-bacfdce54a07 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:00.551496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c820-5ea9-48dc-abcd-bacfdce54a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:00.559084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53c820-5ea9-48dc-abcd-bacfdce54a07 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:00.716396 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1311/2610] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:00 2022] POST /identity/v3/users => generated 278 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:53:00.727905 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:00.729701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:00.806595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9b238-b66c-45e4-83f5-434c9a9b0608 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:00.806595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daaea0-be9e-43fc-8a31-41881b14ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:00.807196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daaea0-be9e-43fc-8a31-41881b14ec2b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.807485 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daaea0-be9e-43fc-8a31-41881b14ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.807767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daaea0-be9e-43fc-8a31-41881b14ec2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:00.808529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daaea0-be9e-43fc-8a31-41881b14ec2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:00.810131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daaea0-be9e-43fc-8a31-41881b14ec2b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:00.821651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1300/2611] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:00.825761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c820-5ea9-48dc-abcd-bacfdce54a07 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:00.836249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53c820-5ea9-48dc-abcd-bacfdce54a07 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:00.840971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099341ee-e4bf-4bc2-90fb-514244864f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:00.841703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099341ee-e4bf-4bc2-90fb-514244864f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.842059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099341ee-e4bf-4bc2-90fb-514244864f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.842409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099341ee-e4bf-4bc2-90fb-514244864f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:00.843272 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099341ee-e4bf-4bc2-90fb-514244864f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:00.844976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099341ee-e4bf-4bc2-90fb-514244864f36 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:00.856150 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1312/2612] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:00.860246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daaea0-be9e-43fc-8a31-41881b14ec2b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:00.871864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daaea0-be9e-43fc-8a31-41881b14ec2b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:00.876704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7bc0-476e-4354-9a83-013c7fc215ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:00.879024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7bc0-476e-4354-9a83-013c7fc215ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.879024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7bc0-476e-4354-9a83-013c7fc215ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.879024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c7bc0-476e-4354-9a83-013c7fc215ad admin admin] PATH_INFO: `/v3/projects/dd44501510e74edbad9fe93cb6b2d7dd/users/e632bcb4b16146f9a5f7cf74fd1a9b4a/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:00.895343 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7bc0-476e-4354-9a83-013c7fc215ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd44501510e74edbad9fe93cb6b2d7dd, user_id=e632bcb4b16146f9a5f7cf74fd1a9b4a, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:00.898567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c7bc0-476e-4354-9a83-013c7fc215ad admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:00.978534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1301/2613] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:00 2022] PUT /identity/v3/projects/dd44501510e74edbad9fe93cb6b2d7dd/users/e632bcb4b16146f9a5f7cf74fd1a9b4a/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:00.988742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580908b-217a-466f-9ad2-495ba3f8c397 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:00.989130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580908b-217a-466f-9ad2-495ba3f8c397 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:00.989397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580908b-217a-466f-9ad2-495ba3f8c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:01.018240 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8580908b-217a-466f-9ad2-495ba3f8c397 None None] MFA Rules not processed for user `e632bcb4b16146f9a5f7cf74fd1a9b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:01.019523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8580908b-217a-466f-9ad2-495ba3f8c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:01.088322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1313/2614] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:00 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:01.093046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7bc0-476e-4354-9a83-013c7fc215ad admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:01.119226 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:01.161116 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c7bc0-476e-4354-9a83-013c7fc215ad admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:01.167120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea2c2-9968-4a68-99a8-b388a94728db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:01.167780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea2c2-9968-4a68-99a8-b388a94728db admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:01.168076 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea2c2-9968-4a68-99a8-b388a94728db admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:01.168405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ea2c2-9968-4a68-99a8-b388a94728db admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:01.169097 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ea2c2-9968-4a68-99a8-b388a94728db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:01.171031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ea2c2-9968-4a68-99a8-b388a94728db admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:01.254950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1302/2615] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:01 2022] POST /identity/v3/projects => generated 357 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:01.256747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580908b-217a-466f-9ad2-495ba3f8c397 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:01.268167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580908b-217a-466f-9ad2-495ba3f8c397 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:01.296784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:01.334421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43388e25-c5f4-4f2a-92d4-3914da8109d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:01.334421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43388e25-c5f4-4f2a-92d4-3914da8109d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:01.334421 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43388e25-c5f4-4f2a-92d4-3914da8109d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:01.334708 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43388e25-c5f4-4f2a-92d4-3914da8109d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:01.335366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43388e25-c5f4-4f2a-92d4-3914da8109d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:01.337324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43388e25-c5f4-4f2a-92d4-3914da8109d6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:01.415139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1314/2616] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:01 2022] POST /identity/v3/users => generated 285 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:01.415260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea2c2-9968-4a68-99a8-b388a94728db admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:01.426012 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ea2c2-9968-4a68-99a8-b388a94728db admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:01.431036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc96b9-b777-4d5e-be17-47bfbec69f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:01.431898 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc96b9-b777-4d5e-be17-47bfbec69f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:01.432180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc96b9-b777-4d5e-be17-47bfbec69f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:01.432449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc96b9-b777-4d5e-be17-47bfbec69f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:01.433176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc96b9-b777-4d5e-be17-47bfbec69f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:01.434753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc96b9-b777-4d5e-be17-47bfbec69f2c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:01.445642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1303/2617] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:01.449761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43388e25-c5f4-4f2a-92d4-3914da8109d6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:01.460469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43388e25-c5f4-4f2a-92d4-3914da8109d6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:01.466563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63153319-2cc9-4e3e-8fe2-6ec06adb5668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:01.467487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63153319-2cc9-4e3e-8fe2-6ec06adb5668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:01.467773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63153319-2cc9-4e3e-8fe2-6ec06adb5668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:01.468049 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63153319-2cc9-4e3e-8fe2-6ec06adb5668 admin admin] PATH_INFO: `/v3/projects/c5ac6953850643b89797ad2686f486ed/users/0b9a0b4ebebe4fb9ab1e5e7f858e9f58/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:01.483725 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63153319-2cc9-4e3e-8fe2-6ec06adb5668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ac6953850643b89797ad2686f486ed, user_id=0b9a0b4ebebe4fb9ab1e5e7f858e9f58, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:01.486382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63153319-2cc9-4e3e-8fe2-6ec06adb5668 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:01.571753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1315/2618] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:01 2022] PUT /identity/v3/projects/c5ac6953850643b89797ad2686f486ed/users/0b9a0b4ebebe4fb9ab1e5e7f858e9f58/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:53:01.575921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc96b9-b777-4d5e-be17-47bfbec69f2c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:01.593886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc96b9-b777-4d5e-be17-47bfbec69f2c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:01.658637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f35265-1645-4293-880a-c181af49919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:01.659340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f35265-1645-4293-880a-c181af49919c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:01.659703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f35265-1645-4293-880a-c181af49919c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:01.660009 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f35265-1645-4293-880a-c181af49919c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:01.661043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f35265-1645-4293-880a-c181af49919c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:01.662838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f35265-1645-4293-880a-c181af49919c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:01.678399 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1304/2619] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:01.681212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63153319-2cc9-4e3e-8fe2-6ec06adb5668 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:01.691767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63153319-2cc9-4e3e-8fe2-6ec06adb5668 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:01.697249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa896f1-fd0b-4a68-9ac3-697b57445b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:01.698134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa896f1-fd0b-4a68-9ac3-697b57445b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:01.698418 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa896f1-fd0b-4a68-9ac3-697b57445b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:01.698749 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa896f1-fd0b-4a68-9ac3-697b57445b1a admin admin] PATH_INFO: `/v3/projects/c5ac6953850643b89797ad2686f486ed/users/0b9a0b4ebebe4fb9ab1e5e7f858e9f58/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:01.701003 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa896f1-fd0b-4a68-9ac3-697b57445b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ac6953850643b89797ad2686f486ed, user_id=0b9a0b4ebebe4fb9ab1e5e7f858e9f58, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:01.703679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa896f1-fd0b-4a68-9ac3-697b57445b1a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:01.715322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1316/2620] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:01 2022] PUT /identity/v3/projects/c5ac6953850643b89797ad2686f486ed/users/0b9a0b4ebebe4fb9ab1e5e7f858e9f58/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:01.726803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4ff01-a582-41eb-a4c6-44dcd69e6d0c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:01.727119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4ff01-a582-41eb-a4c6-44dcd69e6d0c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:01.727405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4ff01-a582-41eb-a4c6-44dcd69e6d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:01.754032 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b0c4ff01-a582-41eb-a4c6-44dcd69e6d0c None None] MFA Rules not processed for user `0b9a0b4ebebe4fb9ab1e5e7f858e9f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:01.755385 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b0c4ff01-a582-41eb-a4c6-44dcd69e6d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:01.831230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1305/2621] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:01 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:01.843269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa896f1-fd0b-4a68-9ac3-697b57445b1a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:01.844999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8aa896f1-fd0b-4a68-9ac3-697b57445b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:01.907027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa896f1-fd0b-4a68-9ac3-697b57445b1a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:01.910629 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01cfd7-68e5-48b6-9cf2-305848b0d7a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:01.911312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01cfd7-68e5-48b6-9cf2-305848b0d7a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:01.911598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01cfd7-68e5-48b6-9cf2-305848b0d7a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:01.911871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01cfd7-68e5-48b6-9cf2-305848b0d7a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:01.921398 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01cfd7-68e5-48b6-9cf2-305848b0d7a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:01.922829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01cfd7-68e5-48b6-9cf2-305848b0d7a1 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:01.932755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1317/2622] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:01 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:02.173288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4ff01-a582-41eb-a4c6-44dcd69e6d0c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:02.184980 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4ff01-a582-41eb-a4c6-44dcd69e6d0c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:02.189231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e224d3b2-647a-44e3-88dd-ead397d2c632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:02.198679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224d3b2-647a-44e3-88dd-ead397d2c632 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:02.198679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224d3b2-647a-44e3-88dd-ead397d2c632 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:02.198679 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e224d3b2-647a-44e3-88dd-ead397d2c632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:02.202684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:02.256838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224d3b2-647a-44e3-88dd-ead397d2c632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:02.258292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e224d3b2-647a-44e3-88dd-ead397d2c632 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:02.273023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1306/2623] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:02 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:06.274493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01cfd7-68e5-48b6-9cf2-305848b0d7a1 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:06.276602 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-be01cfd7-68e5-48b6-9cf2-305848b0d7a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:06.340729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01cfd7-68e5-48b6-9cf2-305848b0d7a1 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:06.345220 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:06.346084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:06.346366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:06.346644 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] PATH_INFO: `/v3/users/ffbc8eb88c1d40888a835035ec151887` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:06.347844 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffbc8eb88c1d40888a835035ec151887)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:06.349754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:06.429318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:06.563266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffbc8eb88c1d40888a835035ec151887'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:06.575551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffbc8eb88c1d40888a835035ec151887'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:06.645625 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffbc8eb88c1d40888a835035ec151887'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:06.646755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffbc8eb88c1d40888a835035ec151887'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:06.654273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffbc8eb88c1d40888a835035ec151887'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:06.660262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1318/2624] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:06 2022] DELETE /identity/v3/users/ffbc8eb88c1d40888a835035ec151887 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:06.664838 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5f38-ab6c-4c38-bab9-f161be6ae6b0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:06.665315 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5f38-ab6c-4c38-bab9-f161be6ae6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:06.665418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5f38-ab6c-4c38-bab9-f161be6ae6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:06.683692 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-de6b5f38-ab6c-4c38-bab9-f161be6ae6b0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:06.684942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-de6b5f38-ab6c-4c38-bab9-f161be6ae6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:06.745895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1307/2625] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:06.755633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:06.757113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:06.815030 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ccf347-feb4-4efb-8ac3-69a14ab687ed admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:06.818647 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a873de-132a-41a7-b215-7d06c36292da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:06.819331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a873de-132a-41a7-b215-7d06c36292da service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:06.819620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a873de-132a-41a7-b215-7d06c36292da service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:06.819898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a873de-132a-41a7-b215-7d06c36292da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:06.829742 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a873de-132a-41a7-b215-7d06c36292da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:06.831481 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a873de-132a-41a7-b215-7d06c36292da service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:06.841408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1319/2626] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:53:07.264156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5f38-ab6c-4c38-bab9-f161be6ae6b0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:07.265895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-de6b5f38-ab6c-4c38-bab9-f161be6ae6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:07.279640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5f38-ab6c-4c38-bab9-f161be6ae6b0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:07.285533 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:07.286523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:07.286723 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:07.287036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] PATH_INFO: `/v3/projects/aa49a0fea77b431b969f0a9573f74319` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:07.288391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa49a0fea77b431b969f0a9573f74319)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:07.291089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:07.394926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa49a0fea77b431b969f0a9573f74319', 'request_id': 'req-336861f3-d5d9-4c23-85d2-a0e63fe34d29'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:07.402219 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa49a0fea77b431b969f0a9573f74319', 'request_id': 'req-336861f3-d5d9-4c23-85d2-a0e63fe34d29'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:07.473605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa49a0fea77b431b969f0a9573f74319', 'request_id': 'req-336861f3-d5d9-4c23-85d2-a0e63fe34d29'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:07.486280 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] The token cache is being invalidate because project aa49a0fea77b431b969f0a9573f74319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:07.486565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:07.487295 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-336861f3-d5d9-4c23-85d2-a0e63fe34d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:07.488835 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1308/2627] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:07 2022] DELETE /identity/v3/projects/aa49a0fea77b431b969f0a9573f74319 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:07.494327 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ffbd-a7d8-4cf3-97ee-bffdd51d51a4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:07.498574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ffbd-a7d8-4cf3-97ee-bffdd51d51a4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:07.498574 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ffbd-a7d8-4cf3-97ee-bffdd51d51a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:07.512740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f757ffbd-a7d8-4cf3-97ee-bffdd51d51a4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:07.513933 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f757ffbd-a7d8-4cf3-97ee-bffdd51d51a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:07.575456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1320/2628] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:07.583309 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d8d90-73dd-45c7-9d5c-14aa394d213b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:07.583597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d8d90-73dd-45c7-9d5c-14aa394d213b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:07.583872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d8d90-73dd-45c7-9d5c-14aa394d213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:07.604476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-132d8d90-73dd-45c7-9d5c-14aa394d213b None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:07.605662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-132d8d90-73dd-45c7-9d5c-14aa394d213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:07.613668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1309/2629] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:07.617770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757ffbd-a7d8-4cf3-97ee-bffdd51d51a4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:07.628175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757ffbd-a7d8-4cf3-97ee-bffdd51d51a4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:07.633550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d526cf4-9537-4343-989e-7cde35b604e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:07.634546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d526cf4-9537-4343-989e-7cde35b604e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:07.634546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d526cf4-9537-4343-989e-7cde35b604e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:07.634998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d526cf4-9537-4343-989e-7cde35b604e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:07.635736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d526cf4-9537-4343-989e-7cde35b604e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:53:07.636178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d526cf4-9537-4343-989e-7cde35b604e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:07.638186 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d526cf4-9537-4343-989e-7cde35b604e3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:07.654230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1321/2630] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:53:07.655468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d8d90-73dd-45c7-9d5c-14aa394d213b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:07.664737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d8d90-73dd-45c7-9d5c-14aa394d213b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:07.670064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1cee3-076a-479c-b3bc-85d0328a9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:07.670818 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1cee3-076a-479c-b3bc-85d0328a9644 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:07.671065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1cee3-076a-479c-b3bc-85d0328a9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:07.671346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1cee3-076a-479c-b3bc-85d0328a9644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:07.672073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1cee3-076a-479c-b3bc-85d0328a9644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:07.674174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1cee3-076a-479c-b3bc-85d0328a9644 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:07.755604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1310/2631] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:07 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:07.759850 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d526cf4-9537-4343-989e-7cde35b604e3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:07.770115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d526cf4-9537-4343-989e-7cde35b604e3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:07.801489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:07.828461 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae6c70-3d0f-408b-9956-f3d48da1c585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:07.829157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae6c70-3d0f-408b-9956-f3d48da1c585 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:07.829442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae6c70-3d0f-408b-9956-f3d48da1c585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:07.829716 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae6c70-3d0f-408b-9956-f3d48da1c585 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:07.830411 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae6c70-3d0f-408b-9956-f3d48da1c585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:07.832439 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae6c70-3d0f-408b-9956-f3d48da1c585 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:07.931631 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1322/2632] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:07 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:53:07.935676 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1cee3-076a-479c-b3bc-85d0328a9644 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:07.947107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1cee3-076a-479c-b3bc-85d0328a9644 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:07.951683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174c20c-109c-4b18-bc31-535f2323f4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:07.952376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174c20c-109c-4b18-bc31-535f2323f4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:07.952665 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174c20c-109c-4b18-bc31-535f2323f4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:07.952984 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174c20c-109c-4b18-bc31-535f2323f4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:07.953708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174c20c-109c-4b18-bc31-535f2323f4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:07.955473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4174c20c-109c-4b18-bc31-535f2323f4c3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:07.956878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:07.966947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1311/2633] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:07.970901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae6c70-3d0f-408b-9956-f3d48da1c585 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:07.981063 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae6c70-3d0f-408b-9956-f3d48da1c585 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:07.986239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2b2bc-8442-426e-b76a-fc0d0fc82e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:07.986962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2b2bc-8442-426e-b76a-fc0d0fc82e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:07.987245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2b2bc-8442-426e-b76a-fc0d0fc82e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:07.987523 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2b2bc-8442-426e-b76a-fc0d0fc82e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:07.988249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2b2bc-8442-426e-b76a-fc0d0fc82e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:07.989890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2b2bc-8442-426e-b76a-fc0d0fc82e40 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:08.002294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1323/2634] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:08.006273 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174c20c-109c-4b18-bc31-535f2323f4c3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:08.017034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174c20c-109c-4b18-bc31-535f2323f4c3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:08.021660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2db96e-66ec-423d-a25f-00000f89ecc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:08.022531 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db96e-66ec-423d-a25f-00000f89ecc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:08.022813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db96e-66ec-423d-a25f-00000f89ecc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:08.023119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db96e-66ec-423d-a25f-00000f89ecc0 admin admin] PATH_INFO: `/v3/projects/73eb3009629e4ddcab335bcf40b97782/users/a86dc6c4e7ce49c393a2e8ae6a1c34d3/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:08.037306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2db96e-66ec-423d-a25f-00000f89ecc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73eb3009629e4ddcab335bcf40b97782, user_id=a86dc6c4e7ce49c393a2e8ae6a1c34d3, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:08.040339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2db96e-66ec-423d-a25f-00000f89ecc0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:08.102682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1312/2635] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:08 2022] PUT /identity/v3/projects/73eb3009629e4ddcab335bcf40b97782/users/a86dc6c4e7ce49c393a2e8ae6a1c34d3/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:08.108324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93d66c-3144-492d-9427-7d3d81e4e869 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:08.108711 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93d66c-3144-492d-9427-7d3d81e4e869 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:08.109004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93d66c-3144-492d-9427-7d3d81e4e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:08.128320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ec93d66c-3144-492d-9427-7d3d81e4e869 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:08.129589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ec93d66c-3144-492d-9427-7d3d81e4e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:08.191167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1324/2636] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:08.201443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2db96e-66ec-423d-a25f-00000f89ecc0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:08.203435 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2c2db96e-66ec-423d-a25f-00000f89ecc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:08.260796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2db96e-66ec-423d-a25f-00000f89ecc0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:08.264418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272885d-6f95-410d-9820-5d8591fa8d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:08.265057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272885d-6f95-410d-9820-5d8591fa8d91 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:08.265336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272885d-6f95-410d-9820-5d8591fa8d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:08.265865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272885d-6f95-410d-9820-5d8591fa8d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:08.274960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272885d-6f95-410d-9820-5d8591fa8d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:08.276474 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272885d-6f95-410d-9820-5d8591fa8d91 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:08.285785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1313/2637] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:13.583211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a40a-026f-460a-9617-cf47075cbe6b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:13.583734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a40a-026f-460a-9617-cf47075cbe6b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:13.583822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a40a-026f-460a-9617-cf47075cbe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:13.626452 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4128a40a-026f-460a-9617-cf47075cbe6b None None] MFA Rules not processed for user `a86dc6c4e7ce49c393a2e8ae6a1c34d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:13.628185 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4128a40a-026f-460a-9617-cf47075cbe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:13.707155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1325/2638] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:13.708861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272885d-6f95-410d-9820-5d8591fa8d91 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:13.719823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272885d-6f95-410d-9820-5d8591fa8d91 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:13.725046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7f5ab-3f59-43ae-8c31-8e62b72c3d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:13.725651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7f5ab-3f59-43ae-8c31-8e62b72c3d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:13.725967 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7f5ab-3f59-43ae-8c31-8e62b72c3d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:13.726247 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7f5ab-3f59-43ae-8c31-8e62b72c3d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:13.727003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7f5ab-3f59-43ae-8c31-8e62b72c3d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:13.728992 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7f5ab-3f59-43ae-8c31-8e62b72c3d66 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:13.818498 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1314/2639] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:13 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:53:13.823385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a40a-026f-460a-9617-cf47075cbe6b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:13.834926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a40a-026f-460a-9617-cf47075cbe6b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:13.887379 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:13.906087 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13473a63-5633-4117-af4f-c90f238925ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:13.913444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473a63-5633-4117-af4f-c90f238925ae admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:13.913444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473a63-5633-4117-af4f-c90f238925ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:13.913444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13473a63-5633-4117-af4f-c90f238925ae admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:13.913444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13473a63-5633-4117-af4f-c90f238925ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:13.913444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13473a63-5633-4117-af4f-c90f238925ae admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:14.017733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1326/2640] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:13 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:53:14.020043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7f5ab-3f59-43ae-8c31-8e62b72c3d66 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:14.034207 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7f5ab-3f59-43ae-8c31-8e62b72c3d66 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:14.039382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adef4a-c271-42d4-b352-15f63d867e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:14.040172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adef4a-c271-42d4-b352-15f63d867e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:14.040454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adef4a-c271-42d4-b352-15f63d867e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:14.043316 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adef4a-c271-42d4-b352-15f63d867e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:14.043316 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adef4a-c271-42d4-b352-15f63d867e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:14.043316 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adef4a-c271-42d4-b352-15f63d867e40 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:14.059176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1315/2641] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:53:14.063762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13473a63-5633-4117-af4f-c90f238925ae admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:14.078620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13473a63-5633-4117-af4f-c90f238925ae admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:14.083939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b114bd5-6989-41fc-bb0b-126511e2cee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:14.084840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114bd5-6989-41fc-bb0b-126511e2cee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:14.085260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114bd5-6989-41fc-bb0b-126511e2cee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:14.085543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b114bd5-6989-41fc-bb0b-126511e2cee6 admin admin] PATH_INFO: `/v3/projects/e95b8cabd55948fb832674ac1a408638/users/f51099a21c5b432d8cb8a878339ecf5b/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:14.104204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b114bd5-6989-41fc-bb0b-126511e2cee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95b8cabd55948fb832674ac1a408638, user_id=f51099a21c5b432d8cb8a878339ecf5b, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:14.107229 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b114bd5-6989-41fc-bb0b-126511e2cee6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:14.211339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1327/2642] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:14 2022] PUT /identity/v3/projects/e95b8cabd55948fb832674ac1a408638/users/f51099a21c5b432d8cb8a878339ecf5b/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:14.215510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adef4a-c271-42d4-b352-15f63d867e40 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:14.225842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adef4a-c271-42d4-b352-15f63d867e40 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:14.294098 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39e77d-8dd4-4242-8a13-5ffa4954faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:14.295064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39e77d-8dd4-4242-8a13-5ffa4954faa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:14.295235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39e77d-8dd4-4242-8a13-5ffa4954faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:14.295497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39e77d-8dd4-4242-8a13-5ffa4954faa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:14.296365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39e77d-8dd4-4242-8a13-5ffa4954faa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:14.298149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39e77d-8dd4-4242-8a13-5ffa4954faa6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:14.311035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1316/2643] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:53:14.314871 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b114bd5-6989-41fc-bb0b-126511e2cee6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:14.329862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b114bd5-6989-41fc-bb0b-126511e2cee6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:14.335075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0e438-f1bf-4ad2-ab23-cd134504e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:14.336044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0e438-f1bf-4ad2-ab23-cd134504e38e admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:14.336549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0e438-f1bf-4ad2-ab23-cd134504e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:14.336923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0e438-f1bf-4ad2-ab23-cd134504e38e admin admin] PATH_INFO: `/v3/projects/e95b8cabd55948fb832674ac1a408638/users/f51099a21c5b432d8cb8a878339ecf5b/roles/9312183c32b04118985c8316f33f3830` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:14.339008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0e438-f1bf-4ad2-ab23-cd134504e38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95b8cabd55948fb832674ac1a408638, user_id=f51099a21c5b432d8cb8a878339ecf5b, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:14.341814 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0e438-f1bf-4ad2-ab23-cd134504e38e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:14.360705 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1328/2644] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:14 2022] PUT /identity/v3/projects/e95b8cabd55948fb832674ac1a408638/users/f51099a21c5b432d8cb8a878339ecf5b/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:21.059074 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d9fe4-b80f-492e-adfc-5db7bbb74630 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:21.059938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d9fe4-b80f-492e-adfc-5db7bbb74630 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:21.059938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d9fe4-b80f-492e-adfc-5db7bbb74630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:21.094504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4b8d9fe4-b80f-492e-adfc-5db7bbb74630 None None] MFA Rules not processed for user `f51099a21c5b432d8cb8a878339ecf5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:21.095880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4b8d9fe4-b80f-492e-adfc-5db7bbb74630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:21.129025 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:21.175520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1317/2645] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:53:21.189580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0e438-f1bf-4ad2-ab23-cd134504e38e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:21.191892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-01d0e438-f1bf-4ad2-ab23-cd134504e38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:21.254982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0e438-f1bf-4ad2-ab23-cd134504e38e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:21.259109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bde05-e423-4365-8ed5-5b972a8bdf22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0a8a5a1bc174acd9b13477c7d4b4a07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:21.259762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bde05-e423-4365-8ed5-5b972a8bdf22 service glance] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:21.260350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bde05-e423-4365-8ed5-5b972a8bdf22 service glance] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:21.260350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bde05-e423-4365-8ed5-5b972a8bdf22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:21.319009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bde05-e423-4365-8ed5-5b972a8bdf22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:21.320489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bde05-e423-4365-8ed5-5b972a8bdf22 service glance] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:21.330435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1329/2646] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:21.595420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386066-1fb3-4b37-942e-c94afe5ec1c3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:21.595714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386066-1fb3-4b37-942e-c94afe5ec1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:21.598039 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d386066-1fb3-4b37-942e-c94afe5ec1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:21.619646 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5d386066-1fb3-4b37-942e-c94afe5ec1c3 None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:21.621007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5d386066-1fb3-4b37-942e-c94afe5ec1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:21.682916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1318/2647] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:53:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:21.708618 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bde05-e423-4365-8ed5-5b972a8bdf22 service glance] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:21.710034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fd8bde05-e423-4365-8ed5-5b972a8bdf22 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:21.764249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:21.785857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bde05-e423-4365-8ed5-5b972a8bdf22 service glance] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:21.792303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf408e22-3670-4076-9e33-30ad9a58d961 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:21.792964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf408e22-3670-4076-9e33-30ad9a58d961 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:21.793256 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf408e22-3670-4076-9e33-30ad9a58d961 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:21.793535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf408e22-3670-4076-9e33-30ad9a58d961 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:21.803056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf408e22-3670-4076-9e33-30ad9a58d961 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:21.804674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf408e22-3670-4076-9e33-30ad9a58d961 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:21.814622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1330/2648] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:53:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:53:21.903493 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386066-1fb3-4b37-942e-c94afe5ec1c3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:21.906283 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5d386066-1fb3-4b37-942e-c94afe5ec1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:22.004276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d386066-1fb3-4b37-942e-c94afe5ec1c3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:22.020122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:22.021248 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:22.021801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:22.022246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] PATH_INFO: `/v3/users/e632bcb4b16146f9a5f7cf74fd1a9b4a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:22.023484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e632bcb4b16146f9a5f7cf74fd1a9b4a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:22.025596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:22.028464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf408e22-3670-4076-9e33-30ad9a58d961 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:22.031970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bf408e22-3670-4076-9e33-30ad9a58d961 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:22.160282 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf408e22-3670-4076-9e33-30ad9a58d961 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:22.169786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f31025-37c4-45be-b308-8675cfd13e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:22.170665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31025-37c4-45be-b308-8675cfd13e46 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:22.171086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31025-37c4-45be-b308-8675cfd13e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:22.171570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f31025-37c4-45be-b308-8675cfd13e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:22.176349 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-90f31025-37c4-45be-b308-8675cfd13e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:22.191939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f31025-37c4-45be-b308-8675cfd13e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:22.194091 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f31025-37c4-45be-b308-8675cfd13e46 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:22.214179 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1331/2649] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:53:22.260039 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e632bcb4b16146f9a5f7cf74fd1a9b4a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:22.261857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e632bcb4b16146f9a5f7cf74fd1a9b4a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:22.299545 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e632bcb4b16146f9a5f7cf74fd1a9b4a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:22.308995 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:22.322883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e632bcb4b16146f9a5f7cf74fd1a9b4a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:22.394422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e632bcb4b16146f9a5f7cf74fd1a9b4a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:22.411278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1319/2650] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:21 2022] DELETE /identity/v3/users/e632bcb4b16146f9a5f7cf74fd1a9b4a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:22.418825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5f54-ea5a-40fa-82a4-f96bc99a2f51 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:22.420663 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5f54-ea5a-40fa-82a4-f96bc99a2f51 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:22.423221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c5f54-ea5a-40fa-82a4-f96bc99a2f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:22.450563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c40c5f54-ea5a-40fa-82a4-f96bc99a2f51 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:22.453069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c40c5f54-ea5a-40fa-82a4-f96bc99a2f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:22.615312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1332/2651] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:22.625663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:22.627826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:22.707850 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33889c4b-8214-4cd5-9adc-36b85259def4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:22.712654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047835-33f7-4c92-ac7c-94c8b6b6ec97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:22.713365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047835-33f7-4c92-ac7c-94c8b6b6ec97 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:22.713656 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047835-33f7-4c92-ac7c-94c8b6b6ec97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:22.713942 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68047835-33f7-4c92-ac7c-94c8b6b6ec97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:22.724997 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68047835-33f7-4c92-ac7c-94c8b6b6ec97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:22.726539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68047835-33f7-4c92-ac7c-94c8b6b6ec97 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:22.739000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1320/2652] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:23.299300 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c5f54-ea5a-40fa-82a4-f96bc99a2f51 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:23.301021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c40c5f54-ea5a-40fa-82a4-f96bc99a2f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:23.331921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c5f54-ea5a-40fa-82a4-f96bc99a2f51 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:23.343867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:23.345160 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:23.345293 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:23.345556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] PATH_INFO: `/v3/projects/dd44501510e74edbad9fe93cb6b2d7dd` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:23.347211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd44501510e74edbad9fe93cb6b2d7dd)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:23.350262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:23.557109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd44501510e74edbad9fe93cb6b2d7dd', 'request_id': 'req-17e1092c-70fc-4306-83f8-3a50ed33dde9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:23.623101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd44501510e74edbad9fe93cb6b2d7dd', 'request_id': 'req-17e1092c-70fc-4306-83f8-3a50ed33dde9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:23.630357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd44501510e74edbad9fe93cb6b2d7dd', 'request_id': 'req-17e1092c-70fc-4306-83f8-3a50ed33dde9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:23.657971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] The token cache is being invalidate because project dd44501510e74edbad9fe93cb6b2d7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:23.658206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:23.658927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:23.661230 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1333/2653] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:23 2022] DELETE /identity/v3/projects/dd44501510e74edbad9fe93cb6b2d7dd => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:23.666971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047835-33f7-4c92-ac7c-94c8b6b6ec97 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:23.679648 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68047835-33f7-4c92-ac7c-94c8b6b6ec97 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:23.789431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:23.791637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:23.792010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:23.792361 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] PATH_INFO: `/v3/users/0b9a0b4ebebe4fb9ab1e5e7f858e9f58` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:23.793659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b9a0b4ebebe4fb9ab1e5e7f858e9f58)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:23.796255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:24.072476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b9a0b4ebebe4fb9ab1e5e7f858e9f58'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:24.073216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b9a0b4ebebe4fb9ab1e5e7f858e9f58'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:24.092866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b9a0b4ebebe4fb9ab1e5e7f858e9f58'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:24.101223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b9a0b4ebebe4fb9ab1e5e7f858e9f58'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:24.182240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9426260c-a2e6-4262-9d8f-ee7ae8c29ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b9a0b4ebebe4fb9ab1e5e7f858e9f58'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:24.189575 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1321/2654] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:23 2022] DELETE /identity/v3/users/0b9a0b4ebebe4fb9ab1e5e7f858e9f58 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:24.929596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:24.932211 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:24.943666 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:24.948594 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1092c-70fc-4306-83f8-3a50ed33dde9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:25.060373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:25.061436 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:25.061826 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:25.062210 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] PATH_INFO: `/v3/projects/c5ac6953850643b89797ad2686f486ed` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:25.063679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ac6953850643b89797ad2686f486ed)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:25.065937 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:25.213012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ac6953850643b89797ad2686f486ed', 'request_id': 'req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:25.321684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ac6953850643b89797ad2686f486ed', 'request_id': 'req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:25.328024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ac6953850643b89797ad2686f486ed', 'request_id': 'req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:25.349289 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] The token cache is being invalidate because project c5ac6953850643b89797ad2686f486ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:25.350741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:25.350741 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a97bc079-f7e6-4d0b-9b3f-22ac66dca818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:25.354079 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1334/2655] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:24 2022] DELETE /identity/v3/projects/c5ac6953850643b89797ad2686f486ed => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:25.358985 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963116b-4351-4532-9a43-8e57b86a8bd4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:25.359497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963116b-4351-4532-9a43-8e57b86a8bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:25.359497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963116b-4351-4532-9a43-8e57b86a8bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:25.400788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c963116b-4351-4532-9a43-8e57b86a8bd4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:25.402031 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c963116b-4351-4532-9a43-8e57b86a8bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:25.411711 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:25.566459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1322/2656] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:25.583314 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde24b8e-318a-49ec-8e81-315caea24efe None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:25.583608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde24b8e-318a-49ec-8e81-315caea24efe None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:25.583896 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde24b8e-318a-49ec-8e81-315caea24efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:25.636931 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bde24b8e-318a-49ec-8e81-315caea24efe None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:25.644159 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bde24b8e-318a-49ec-8e81-315caea24efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:25.662370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963116b-4351-4532-9a43-8e57b86a8bd4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:25.668051 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1335/2657] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:25.677887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963116b-4351-4532-9a43-8e57b86a8bd4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:25.690210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79506808-27d1-429e-8b35-63db138be09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:25.691232 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79506808-27d1-429e-8b35-63db138be09c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:25.691529 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79506808-27d1-429e-8b35-63db138be09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:25.695206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79506808-27d1-429e-8b35-63db138be09c admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:25.695206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79506808-27d1-429e-8b35-63db138be09c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:53:25.695206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79506808-27d1-429e-8b35-63db138be09c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:25.695206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79506808-27d1-429e-8b35-63db138be09c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:25.725788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1323/2658] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:53:25.730509 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde24b8e-318a-49ec-8e81-315caea24efe None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:25.741572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde24b8e-318a-49ec-8e81-315caea24efe None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:25.750970 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4470e27-1618-4bff-bf31-94e33afe1d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:25.751849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4470e27-1618-4bff-bf31-94e33afe1d50 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:25.752243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4470e27-1618-4bff-bf31-94e33afe1d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:25.752643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4470e27-1618-4bff-bf31-94e33afe1d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:25.753468 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4470e27-1618-4bff-bf31-94e33afe1d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:25.755660 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4470e27-1618-4bff-bf31-94e33afe1d50 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:25.881577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1336/2659] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:25 2022] POST /identity/v3/projects => generated 365 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:25.885652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79506808-27d1-429e-8b35-63db138be09c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:25.931104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79506808-27d1-429e-8b35-63db138be09c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:25.985126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438632e-6734-4747-9b63-3f8aa66a9e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:25.985827 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438632e-6734-4747-9b63-3f8aa66a9e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:25.986117 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438632e-6734-4747-9b63-3f8aa66a9e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:25.986401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438632e-6734-4747-9b63-3f8aa66a9e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:25.987202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438632e-6734-4747-9b63-3f8aa66a9e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:25.989653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438632e-6734-4747-9b63-3f8aa66a9e56 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:26.411653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1324/2660] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:25 2022] POST /identity/v3/users => generated 283 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:26.415886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4470e27-1618-4bff-bf31-94e33afe1d50 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:26.430412 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4470e27-1618-4bff-bf31-94e33afe1d50 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:26.435589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92ee4b-1127-4a8a-9479-6899c6723a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:26.438255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92ee4b-1127-4a8a-9479-6899c6723a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:26.438255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92ee4b-1127-4a8a-9479-6899c6723a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:26.438255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92ee4b-1127-4a8a-9479-6899c6723a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:26.438255 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92ee4b-1127-4a8a-9479-6899c6723a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:26.439603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92ee4b-1127-4a8a-9479-6899c6723a31 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:26.454515 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1337/2661] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:53:26.467266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438632e-6734-4747-9b63-3f8aa66a9e56 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:26.500955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438632e-6734-4747-9b63-3f8aa66a9e56 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:26.533578 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9558093-f24a-427e-9c14-7d8d622817c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:26.534374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9558093-f24a-427e-9c14-7d8d622817c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:26.534737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9558093-f24a-427e-9c14-7d8d622817c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:26.535109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9558093-f24a-427e-9c14-7d8d622817c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:26.535936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9558093-f24a-427e-9c14-7d8d622817c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:26.539834 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9558093-f24a-427e-9c14-7d8d622817c4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:26.594147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1325/2662] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:26.598549 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92ee4b-1127-4a8a-9479-6899c6723a31 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:26.611600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92ee4b-1127-4a8a-9479-6899c6723a31 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:26.617746 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394330dc-cba7-4e8f-b610-b0dae1ebfe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:26.620090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394330dc-cba7-4e8f-b610-b0dae1ebfe69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:26.620608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394330dc-cba7-4e8f-b610-b0dae1ebfe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:26.621130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394330dc-cba7-4e8f-b610-b0dae1ebfe69 admin admin] PATH_INFO: `/v3/projects/69d786cbba7646fbbb60a34c9ddb07c2/users/e9d81be3acbe4e7883f218e792d37bba/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:26.669897 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394330dc-cba7-4e8f-b610-b0dae1ebfe69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d786cbba7646fbbb60a34c9ddb07c2, user_id=e9d81be3acbe4e7883f218e792d37bba, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:26.674626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394330dc-cba7-4e8f-b610-b0dae1ebfe69 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:26.808320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1338/2663] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:26 2022] PUT /identity/v3/projects/69d786cbba7646fbbb60a34c9ddb07c2/users/e9d81be3acbe4e7883f218e792d37bba/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:26.818584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13b4f-3528-48b5-a0c5-8c7e5d308c83 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:26.818909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13b4f-3528-48b5-a0c5-8c7e5d308c83 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:26.819174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13b4f-3528-48b5-a0c5-8c7e5d308c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:26.864377 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c5e13b4f-3528-48b5-a0c5-8c7e5d308c83 None None] MFA Rules not processed for user `e9d81be3acbe4e7883f218e792d37bba`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:26.865846 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c5e13b4f-3528-48b5-a0c5-8c7e5d308c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:26.999504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1326/2664] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:27.003852 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394330dc-cba7-4e8f-b610-b0dae1ebfe69 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:27.111069 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:27.164611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394330dc-cba7-4e8f-b610-b0dae1ebfe69 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:27.173316 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0726c0-1ab7-4bd8-8a29-8d6ca891e1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:27.174351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0726c0-1ab7-4bd8-8a29-8d6ca891e1bc admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:27.174803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0726c0-1ab7-4bd8-8a29-8d6ca891e1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:27.175375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0726c0-1ab7-4bd8-8a29-8d6ca891e1bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:27.176391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0726c0-1ab7-4bd8-8a29-8d6ca891e1bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:27.178694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0726c0-1ab7-4bd8-8a29-8d6ca891e1bc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:27.322577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1339/2665] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:27 2022] POST /identity/v3/projects => generated 363 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:27.322753 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e13b4f-3528-48b5-a0c5-8c7e5d308c83 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:27.332211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:27.342794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e13b4f-3528-48b5-a0c5-8c7e5d308c83 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:27.486595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365d636-8a9c-470e-af31-5e73935bfa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:27.488101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365d636-8a9c-470e-af31-5e73935bfa40 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:27.488598 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365d636-8a9c-470e-af31-5e73935bfa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:27.489450 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365d636-8a9c-470e-af31-5e73935bfa40 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:27.491260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365d636-8a9c-470e-af31-5e73935bfa40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:27.495475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365d636-8a9c-470e-af31-5e73935bfa40 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:27.649144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1327/2666] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:27 2022] POST /identity/v3/users => generated 288 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:27.653496 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0726c0-1ab7-4bd8-8a29-8d6ca891e1bc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:27.673145 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0726c0-1ab7-4bd8-8a29-8d6ca891e1bc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:27.679202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7573a-2a8d-481f-bb9d-a71dde1f817f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:27.680853 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7573a-2a8d-481f-bb9d-a71dde1f817f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:27.681573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7573a-2a8d-481f-bb9d-a71dde1f817f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:27.681573 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7573a-2a8d-481f-bb9d-a71dde1f817f admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:27.682123 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7573a-2a8d-481f-bb9d-a71dde1f817f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:27.683796 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf7573a-2a8d-481f-bb9d-a71dde1f817f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:27.719416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1340/2667] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:27.723296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365d636-8a9c-470e-af31-5e73935bfa40 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:27.745100 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365d636-8a9c-470e-af31-5e73935bfa40 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:27.756702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2380b19-5893-40eb-93a9-a4d7e6fba19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:27.757841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2380b19-5893-40eb-93a9-a4d7e6fba19e admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:27.760541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2380b19-5893-40eb-93a9-a4d7e6fba19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:27.761382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2380b19-5893-40eb-93a9-a4d7e6fba19e admin admin] PATH_INFO: `/v3/projects/85d142742e2a436d8c00ae0a9ae934ca/users/c0f976da8b97471ab98036427d9a24db/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:27.792674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2380b19-5893-40eb-93a9-a4d7e6fba19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d142742e2a436d8c00ae0a9ae934ca, user_id=c0f976da8b97471ab98036427d9a24db, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:27.795681 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2380b19-5893-40eb-93a9-a4d7e6fba19e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:27.857550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1328/2668] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:27 2022] PUT /identity/v3/projects/85d142742e2a436d8c00ae0a9ae934ca/users/c0f976da8b97471ab98036427d9a24db/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:27.861668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7573a-2a8d-481f-bb9d-a71dde1f817f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:27.879362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7573a-2a8d-481f-bb9d-a71dde1f817f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:28.007874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608d240-a90b-454c-ae1c-7ea32c50d30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:28.009440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d240-a90b-454c-ae1c-7ea32c50d30d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:28.009797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d240-a90b-454c-ae1c-7ea32c50d30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:28.010146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608d240-a90b-454c-ae1c-7ea32c50d30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:28.011001 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608d240-a90b-454c-ae1c-7ea32c50d30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:28.013075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608d240-a90b-454c-ae1c-7ea32c50d30d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:28.052774 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1341/2669] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:28.057389 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2380b19-5893-40eb-93a9-a4d7e6fba19e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:28.074260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2380b19-5893-40eb-93a9-a4d7e6fba19e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:28.083683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a877-2606-4380-b2a5-65fa1fb6e673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:28.090439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a877-2606-4380-b2a5-65fa1fb6e673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:28.091356 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a877-2606-4380-b2a5-65fa1fb6e673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:28.091866 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5a877-2606-4380-b2a5-65fa1fb6e673 admin admin] PATH_INFO: `/v3/projects/85d142742e2a436d8c00ae0a9ae934ca/users/c0f976da8b97471ab98036427d9a24db/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:28.095350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5a877-2606-4380-b2a5-65fa1fb6e673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d142742e2a436d8c00ae0a9ae934ca, user_id=c0f976da8b97471ab98036427d9a24db, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:28.104411 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5a877-2606-4380-b2a5-65fa1fb6e673 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:28.116467 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1329/2670] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:28 2022] PUT /identity/v3/projects/85d142742e2a436d8c00ae0a9ae934ca/users/c0f976da8b97471ab98036427d9a24db/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:28.135022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7857b0-f4ef-4973-a459-f4f4e68781cc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:28.135022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7857b0-f4ef-4973-a459-f4f4e68781cc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:28.135022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7857b0-f4ef-4973-a459-f4f4e68781cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:28.172634 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1b7857b0-f4ef-4973-a459-f4f4e68781cc None None] MFA Rules not processed for user `c0f976da8b97471ab98036427d9a24db`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:28.174268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1b7857b0-f4ef-4973-a459-f4f4e68781cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:28.182249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a877-2606-4380-b2a5-65fa1fb6e673 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:28.184281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-80b5a877-2606-4380-b2a5-65fa1fb6e673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:28.317362 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5a877-2606-4380-b2a5-65fa1fb6e673 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:28.330107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:28.331621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:28.331910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:28.332192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] PATH_INFO: `/v3/users/38331c36830a426cbc41b370c707e44c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:28.339430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1342/2671] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:28 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:28.339950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=38331c36830a426cbc41b370c707e44c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:28.342089 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:28.351139 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7857b0-f4ef-4973-a459-f4f4e68781cc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:28.353155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1b7857b0-f4ef-4973-a459-f4f4e68781cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:28.403045 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:28.437245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7857b0-f4ef-4973-a459-f4f4e68781cc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:28.441227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6ac2-f6c4-4e75-8a13-792a002079cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:28.445568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6ac2-f6c4-4e75-8a13-792a002079cd service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:28.445568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6ac2-f6c4-4e75-8a13-792a002079cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:28.445568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6ac2-f6c4-4e75-8a13-792a002079cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:28.469699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6ac2-f6c4-4e75-8a13-792a002079cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:28.469699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6ac2-f6c4-4e75-8a13-792a002079cd service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:28.492092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1343/2672] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:28 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:28.563022 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38331c36830a426cbc41b370c707e44c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:28.564062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38331c36830a426cbc41b370c707e44c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:28.597148 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:28.603463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38331c36830a426cbc41b370c707e44c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:28.614765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38331c36830a426cbc41b370c707e44c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:28.702325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38331c36830a426cbc41b370c707e44c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:28.712276 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1330/2673] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:28 2022] DELETE /identity/v3/users/38331c36830a426cbc41b370c707e44c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:53:28.728288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6ac2-f6c4-4e75-8a13-792a002079cd service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:28.747610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6ac2-f6c4-4e75-8a13-792a002079cd service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:28.867659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea981339-ad67-4e54-acfd-ab997bf8b560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:28.868992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea981339-ad67-4e54-acfd-ab997bf8b560 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:28.869286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea981339-ad67-4e54-acfd-ab997bf8b560 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:28.869568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea981339-ad67-4e54-acfd-ab997bf8b560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:28.872237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ea981339-ad67-4e54-acfd-ab997bf8b560 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:28.996684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea981339-ad67-4e54-acfd-ab997bf8b560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:28.999290 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea981339-ad67-4e54-acfd-ab997bf8b560 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:29.020601 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1344/2674] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:29.145988 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:29.147577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:29.259736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ea6d1-1733-4f3c-9e3a-d9fedc75f2ad admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:29.266760 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:29.267614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:29.267950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:29.268233 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] PATH_INFO: `/v3/projects/ab0a9ec4d2f74272a44f3d4ac22dd89a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:29.269561 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0a9ec4d2f74272a44f3d4ac22dd89a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:29.271605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:29.407883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0a9ec4d2f74272a44f3d4ac22dd89a', 'request_id': 'req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:29.438680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0a9ec4d2f74272a44f3d4ac22dd89a', 'request_id': 'req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:29.542202 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0a9ec4d2f74272a44f3d4ac22dd89a', 'request_id': 'req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:29.558206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] The token cache is being invalidate because project ab0a9ec4d2f74272a44f3d4ac22dd89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:29.558570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:29.559196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22640d1d-5a3f-40f1-a5aa-e1aed38340c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:29.561072 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1331/2675] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:29 2022] DELETE /identity/v3/projects/ab0a9ec4d2f74272a44f3d4ac22dd89a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:29.565797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cceec6-657c-45ed-931d-011a92150ed8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:29.566089 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cceec6-657c-45ed-931d-011a92150ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:29.566370 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cceec6-657c-45ed-931d-011a92150ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:29.589130 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b6cceec6-657c-45ed-931d-011a92150ed8 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:29.590909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b6cceec6-657c-45ed-931d-011a92150ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:29.658950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1345/2676] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:53:29.667680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9543d46-cebe-4e54-86b5-5ba5c6bbcd41 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:29.668268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9543d46-cebe-4e54-86b5-5ba5c6bbcd41 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:29.668268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9543d46-cebe-4e54-86b5-5ba5c6bbcd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:29.690970 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d9543d46-cebe-4e54-86b5-5ba5c6bbcd41 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:29.692351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d9543d46-cebe-4e54-86b5-5ba5c6bbcd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:29.702024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1332/2677] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:29.706586 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cceec6-657c-45ed-931d-011a92150ed8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:29.718920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cceec6-657c-45ed-931d-011a92150ed8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:29.725061 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd054d-167b-4132-88a4-1ce86571c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:29.728304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd054d-167b-4132-88a4-1ce86571c8dd admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:29.728304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd054d-167b-4132-88a4-1ce86571c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:29.728304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd054d-167b-4132-88a4-1ce86571c8dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:29.728304 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd054d-167b-4132-88a4-1ce86571c8dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:53:29.729177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd054d-167b-4132-88a4-1ce86571c8dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:29.732036 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd054d-167b-4132-88a4-1ce86571c8dd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:29.749770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1346/2678] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:53:29.751564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9543d46-cebe-4e54-86b5-5ba5c6bbcd41 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:29.762378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9543d46-cebe-4e54-86b5-5ba5c6bbcd41 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:29.767539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9be5-22ec-430e-b30b-aa6695223c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:29.768880 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9be5-22ec-430e-b30b-aa6695223c2f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:29.769174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9be5-22ec-430e-b30b-aa6695223c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:29.770427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca9be5-22ec-430e-b30b-aa6695223c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:29.770427 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca9be5-22ec-430e-b30b-aa6695223c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:29.772418 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca9be5-22ec-430e-b30b-aa6695223c2f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:29.842436 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1333/2679] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:29 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:29.847138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd054d-167b-4132-88a4-1ce86571c8dd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:29.860443 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd054d-167b-4132-88a4-1ce86571c8dd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:29.873945 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:29.935609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b2e4c-1983-4aa5-b4cf-3e9c734710f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:29.936306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b2e4c-1983-4aa5-b4cf-3e9c734710f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:29.936628 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b2e4c-1983-4aa5-b4cf-3e9c734710f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:29.936882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b2e4c-1983-4aa5-b4cf-3e9c734710f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:29.937581 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b2e4c-1983-4aa5-b4cf-3e9c734710f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:29.939570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b2e4c-1983-4aa5-b4cf-3e9c734710f2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:30.003501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1347/2680] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:29 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:30.007706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9be5-22ec-430e-b30b-aa6695223c2f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:30.021707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca9be5-22ec-430e-b30b-aa6695223c2f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:30.027386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17e94-3b72-459f-bfdf-3e8413fcc64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:30.028069 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17e94-3b72-459f-bfdf-3e8413fcc64a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:30.028355 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17e94-3b72-459f-bfdf-3e8413fcc64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:30.028635 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17e94-3b72-459f-bfdf-3e8413fcc64a admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:30.029374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a17e94-3b72-459f-bfdf-3e8413fcc64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:30.031029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a17e94-3b72-459f-bfdf-3e8413fcc64a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:30.053378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1334/2681] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:30.054706 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b2e4c-1983-4aa5-b4cf-3e9c734710f2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:30.067294 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b2e4c-1983-4aa5-b4cf-3e9c734710f2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:30.074981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06693d72-a1c2-45e9-b968-51682556afbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:30.075791 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06693d72-a1c2-45e9-b968-51682556afbe admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:30.076268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06693d72-a1c2-45e9-b968-51682556afbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:30.076713 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06693d72-a1c2-45e9-b968-51682556afbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:30.077569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06693d72-a1c2-45e9-b968-51682556afbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:30.079330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06693d72-a1c2-45e9-b968-51682556afbe admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:30.090880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1348/2682] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:30.097588 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17e94-3b72-459f-bfdf-3e8413fcc64a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:30.109950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17e94-3b72-459f-bfdf-3e8413fcc64a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:30.116445 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed48d-f85f-4edf-9613-a83a5345c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:30.117461 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed48d-f85f-4edf-9613-a83a5345c9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:30.118462 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed48d-f85f-4edf-9613-a83a5345c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:30.118743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caed48d-f85f-4edf-9613-a83a5345c9d0 admin admin] PATH_INFO: `/v3/projects/5d726384b95f4b2bb030634e6186c250/users/7f7e749daaac46eebb387cf487c0e9b5/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:30.145339 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caed48d-f85f-4edf-9613-a83a5345c9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d726384b95f4b2bb030634e6186c250, user_id=7f7e749daaac46eebb387cf487c0e9b5, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:30.148310 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caed48d-f85f-4edf-9613-a83a5345c9d0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:30.275433 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1335/2683] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:30 2022] PUT /identity/v3/projects/5d726384b95f4b2bb030634e6186c250/users/7f7e749daaac46eebb387cf487c0e9b5/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:30.286556 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a54d3f-0c93-4b4b-b9ef-dd5f6d57e626 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:30.286869 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a54d3f-0c93-4b4b-b9ef-dd5f6d57e626 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:30.287165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a54d3f-0c93-4b4b-b9ef-dd5f6d57e626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:30.319373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-21a54d3f-0c93-4b4b-b9ef-dd5f6d57e626 None None] MFA Rules not processed for user `7f7e749daaac46eebb387cf487c0e9b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:30.321188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-21a54d3f-0c93-4b4b-b9ef-dd5f6d57e626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:30.402227 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1349/2684] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:30.413241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed48d-f85f-4edf-9613-a83a5345c9d0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:30.415808 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2caed48d-f85f-4edf-9613-a83a5345c9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:30.421409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:30.497754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caed48d-f85f-4edf-9613-a83a5345c9d0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:30.504766 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4dd40b-c3e5-4f2d-b220-55e42c706578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:30.505549 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dd40b-c3e5-4f2d-b220-55e42c706578 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:30.505888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dd40b-c3e5-4f2d-b220-55e42c706578 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:30.506163 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dd40b-c3e5-4f2d-b220-55e42c706578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:30.515685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dd40b-c3e5-4f2d-b220-55e42c706578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:30.517541 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4dd40b-c3e5-4f2d-b220-55e42c706578 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:30.527409 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1336/2685] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:34.001199 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a54d3f-0c93-4b4b-b9ef-dd5f6d57e626 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:34.082522 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a54d3f-0c93-4b4b-b9ef-dd5f6d57e626 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:34.088806 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:34.089703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:34.089963 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:34.090244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] PATH_INFO: `/v3/users/7f7e749daaac46eebb387cf487c0e9b5` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:34.091513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7e749daaac46eebb387cf487c0e9b5)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:34.093471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:34.118380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:34.310829 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7e749daaac46eebb387cf487c0e9b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:34.324059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7e749daaac46eebb387cf487c0e9b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:34.382163 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7e749daaac46eebb387cf487c0e9b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:34.382709 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7e749daaac46eebb387cf487c0e9b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:34.391923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7e749daaac46eebb387cf487c0e9b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:34.398562 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1350/2686] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:33 2022] DELETE /identity/v3/users/7f7e749daaac46eebb387cf487c0e9b5 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:34.403390 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a13b-2324-41a8-a55b-1f0830f10507 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:34.403887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a13b-2324-41a8-a55b-1f0830f10507 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:34.404005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a13b-2324-41a8-a55b-1f0830f10507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:34.421709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-aa04a13b-2324-41a8-a55b-1f0830f10507 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:34.422931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-aa04a13b-2324-41a8-a55b-1f0830f10507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:34.488041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1337/2687] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:34.498754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:34.500322 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:34.561253 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ce696-6639-4666-908b-661f058259b0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:34.567181 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b9a15-187e-45fe-ab9e-b36517b03175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:34.567947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b9a15-187e-45fe-ab9e-b36517b03175 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:34.568214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b9a15-187e-45fe-ab9e-b36517b03175 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:34.568397 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b9a15-187e-45fe-ab9e-b36517b03175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:34.578466 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b9a15-187e-45fe-ab9e-b36517b03175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:34.580011 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b9a15-187e-45fe-ab9e-b36517b03175 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:34.590695 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1351/2688] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:34.902084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b453e-21bf-4e7b-9a3a-6e2473e0d854 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:34.902405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b453e-21bf-4e7b-9a3a-6e2473e0d854 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:34.902751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b453e-21bf-4e7b-9a3a-6e2473e0d854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:34.922263 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-849b453e-21bf-4e7b-9a3a-6e2473e0d854 None None] MFA Rules not processed for user `a86dc6c4e7ce49c393a2e8ae6a1c34d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:34.923518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-849b453e-21bf-4e7b-9a3a-6e2473e0d854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:34.988231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1338/2689] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:35.042430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b9a15-187e-45fe-ab9e-b36517b03175 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:35.043986 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7a8b9a15-187e-45fe-ab9e-b36517b03175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:35.065722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b9a15-187e-45fe-ab9e-b36517b03175 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:35.074297 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:35.075329 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:35.075501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:35.075862 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] PATH_INFO: `/v3/projects/5d726384b95f4b2bb030634e6186c250` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:35.077976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d726384b95f4b2bb030634e6186c250)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:35.081081 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:35.222613 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d726384b95f4b2bb030634e6186c250', 'request_id': 'req-f10a6181-9a2e-411f-90bc-74e6613281c3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:35.313547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d726384b95f4b2bb030634e6186c250', 'request_id': 'req-f10a6181-9a2e-411f-90bc-74e6613281c3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:35.319804 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d726384b95f4b2bb030634e6186c250', 'request_id': 'req-f10a6181-9a2e-411f-90bc-74e6613281c3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:35.331740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] The token cache is being invalidate because project 5d726384b95f4b2bb030634e6186c250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:35.332031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:35.332773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f10a6181-9a2e-411f-90bc-74e6613281c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:35.334332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1352/2690] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:35 2022] DELETE /identity/v3/projects/5d726384b95f4b2bb030634e6186c250 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:35.339779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3155101-345b-4320-8c62-3ebdd1036cec None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:35.340181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3155101-345b-4320-8c62-3ebdd1036cec None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:35.340593 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3155101-345b-4320-8c62-3ebdd1036cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:35.359821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c3155101-345b-4320-8c62-3ebdd1036cec None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:35.361298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c3155101-345b-4320-8c62-3ebdd1036cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:35.394506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:35.433762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1339/2691] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:35.441239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5fc5c-4457-4d10-8c07-cf578c21b11d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:35.441534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5fc5c-4457-4d10-8c07-cf578c21b11d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:35.441817 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5fc5c-4457-4d10-8c07-cf578c21b11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:35.467773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-63b5fc5c-4457-4d10-8c07-cf578c21b11d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:35.467773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-63b5fc5c-4457-4d10-8c07-cf578c21b11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:35.473960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1353/2692] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:35.478902 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3155101-345b-4320-8c62-3ebdd1036cec None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:35.489050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3155101-345b-4320-8c62-3ebdd1036cec None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:35.494613 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ade29-7933-42d4-9ffa-6bd870542417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:35.495330 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ade29-7933-42d4-9ffa-6bd870542417 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:35.495626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ade29-7933-42d4-9ffa-6bd870542417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:35.495910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ade29-7933-42d4-9ffa-6bd870542417 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:35.496645 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ade29-7933-42d4-9ffa-6bd870542417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:53:35.496961 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ade29-7933-42d4-9ffa-6bd870542417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:35.498573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ade29-7933-42d4-9ffa-6bd870542417 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:35.511596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1340/2693] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:53:35.516053 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5fc5c-4457-4d10-8c07-cf578c21b11d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:35.525532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5fc5c-4457-4d10-8c07-cf578c21b11d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:35.530992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4fb56-50b4-4f21-8d4c-84d57011399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:35.531651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4fb56-50b4-4f21-8d4c-84d57011399e admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:35.531939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4fb56-50b4-4f21-8d4c-84d57011399e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:35.532217 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4fb56-50b4-4f21-8d4c-84d57011399e admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:35.532902 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4fb56-50b4-4f21-8d4c-84d57011399e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:35.534867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4fb56-50b4-4f21-8d4c-84d57011399e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:35.549368 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:35.655710 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1354/2694] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:35 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:35.657184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ade29-7933-42d4-9ffa-6bd870542417 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:35.677659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ade29-7933-42d4-9ffa-6bd870542417 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:35.755660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beef60-75ec-457f-90e1-3cd1fbdbe3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:35.756775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beef60-75ec-457f-90e1-3cd1fbdbe3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:35.757086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beef60-75ec-457f-90e1-3cd1fbdbe3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:35.757364 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beef60-75ec-457f-90e1-3cd1fbdbe3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:35.758101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beef60-75ec-457f-90e1-3cd1fbdbe3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:35.760404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0beef60-75ec-457f-90e1-3cd1fbdbe3b4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:35.860986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1341/2695] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:35 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:35.862406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4fb56-50b4-4f21-8d4c-84d57011399e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:35.872699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4fb56-50b4-4f21-8d4c-84d57011399e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:35.877134 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84635-a3da-4ce4-8428-d483ce9292ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:35.877785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84635-a3da-4ce4-8428-d483ce9292ce admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:35.878067 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84635-a3da-4ce4-8428-d483ce9292ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:35.878348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e84635-a3da-4ce4-8428-d483ce9292ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:35.879101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84635-a3da-4ce4-8428-d483ce9292ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:35.880689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e84635-a3da-4ce4-8428-d483ce9292ce admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:35.891759 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1355/2696] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:35.895657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beef60-75ec-457f-90e1-3cd1fbdbe3b4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:35.906391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beef60-75ec-457f-90e1-3cd1fbdbe3b4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:35.911036 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2167a-d215-48bd-80e9-46076bfd2c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:35.911628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2167a-d215-48bd-80e9-46076bfd2c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:35.911911 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2167a-d215-48bd-80e9-46076bfd2c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:35.912190 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2167a-d215-48bd-80e9-46076bfd2c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:35.912909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2167a-d215-48bd-80e9-46076bfd2c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:35.915640 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2167a-d215-48bd-80e9-46076bfd2c94 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:35.925416 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1342/2697] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:35.929419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84635-a3da-4ce4-8428-d483ce9292ce admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:35.940097 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e84635-a3da-4ce4-8428-d483ce9292ce admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:35.944873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaf6b4-2e8f-4800-bd94-6f35bbd90420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:35.946394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaf6b4-2e8f-4800-bd94-6f35bbd90420 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:35.946650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaf6b4-2e8f-4800-bd94-6f35bbd90420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:35.952246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eaf6b4-2e8f-4800-bd94-6f35bbd90420 admin admin] PATH_INFO: `/v3/projects/62f03a8600e342249b630a20fe086173/users/a4dc2552bdc04b86b91754d6317f30b9/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:35.962221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eaf6b4-2e8f-4800-bd94-6f35bbd90420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f03a8600e342249b630a20fe086173, user_id=a4dc2552bdc04b86b91754d6317f30b9, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:35.964947 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eaf6b4-2e8f-4800-bd94-6f35bbd90420 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:36.062416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1356/2698] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:35 2022] PUT /identity/v3/projects/62f03a8600e342249b630a20fe086173/users/a4dc2552bdc04b86b91754d6317f30b9/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:36.074621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7c681-7c10-4e11-8626-2c5fde6e33b6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:36.074958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7c681-7c10-4e11-8626-2c5fde6e33b6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:36.075239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7c681-7c10-4e11-8626-2c5fde6e33b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:36.103011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-12a7c681-7c10-4e11-8626-2c5fde6e33b6 None None] MFA Rules not processed for user `a4dc2552bdc04b86b91754d6317f30b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:36.104264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-12a7c681-7c10-4e11-8626-2c5fde6e33b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:36.169788 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1343/2699] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:36.174506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaf6b4-2e8f-4800-bd94-6f35bbd90420 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:36.240350 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eaf6b4-2e8f-4800-bd94-6f35bbd90420 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:36.245365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11b406-3b4a-4420-b01d-7d9687d45888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:36.246026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11b406-3b4a-4420-b01d-7d9687d45888 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:36.246313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11b406-3b4a-4420-b01d-7d9687d45888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:36.246600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11b406-3b4a-4420-b01d-7d9687d45888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:36.247467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11b406-3b4a-4420-b01d-7d9687d45888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:36.249376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11b406-3b4a-4420-b01d-7d9687d45888 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:36.337299 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1357/2700] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:36 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:36.341614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7c681-7c10-4e11-8626-2c5fde6e33b6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:36.352581 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7c681-7c10-4e11-8626-2c5fde6e33b6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:36.378387 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:36.410014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b91061-5b3c-4d97-b567-e4aa0d2f9df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:36.410713 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b91061-5b3c-4d97-b567-e4aa0d2f9df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:36.411055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b91061-5b3c-4d97-b567-e4aa0d2f9df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:36.411335 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b91061-5b3c-4d97-b567-e4aa0d2f9df4 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:36.412156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b91061-5b3c-4d97-b567-e4aa0d2f9df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:36.414067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b91061-5b3c-4d97-b567-e4aa0d2f9df4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:36.511090 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1344/2701] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:36 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:36.513099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11b406-3b4a-4420-b01d-7d9687d45888 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:36.526473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11b406-3b4a-4420-b01d-7d9687d45888 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:36.532113 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf8d05-4098-4e4b-9db5-58daeae28a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:36.534723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf8d05-4098-4e4b-9db5-58daeae28a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:36.534723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf8d05-4098-4e4b-9db5-58daeae28a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:36.534723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf8d05-4098-4e4b-9db5-58daeae28a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:36.534723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf8d05-4098-4e4b-9db5-58daeae28a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:36.535652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf8d05-4098-4e4b-9db5-58daeae28a2a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:36.550797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1358/2702] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:36.555651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b91061-5b3c-4d97-b567-e4aa0d2f9df4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:36.566238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b91061-5b3c-4d97-b567-e4aa0d2f9df4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:36.571887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ea30-2010-4f10-9d4d-b7d76fc20ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:36.572638 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ea30-2010-4f10-9d4d-b7d76fc20ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:36.572923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ea30-2010-4f10-9d4d-b7d76fc20ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:36.573230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6ea30-2010-4f10-9d4d-b7d76fc20ed4 admin admin] PATH_INFO: `/v3/projects/420bb68ee4514b19b770a1cb32231b75/users/1240be2658724a81b0b13715dc0be884/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:36.598820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6ea30-2010-4f10-9d4d-b7d76fc20ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420bb68ee4514b19b770a1cb32231b75, user_id=1240be2658724a81b0b13715dc0be884, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:36.601667 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6ea30-2010-4f10-9d4d-b7d76fc20ed4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:36.731193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1345/2703] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:36 2022] PUT /identity/v3/projects/420bb68ee4514b19b770a1cb32231b75/users/1240be2658724a81b0b13715dc0be884/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:36.735200 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf8d05-4098-4e4b-9db5-58daeae28a2a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:36.745665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf8d05-4098-4e4b-9db5-58daeae28a2a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:36.804762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a90755-b9f8-4f14-a1a2-84429148accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:36.806193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a90755-b9f8-4f14-a1a2-84429148accc admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:36.806343 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a90755-b9f8-4f14-a1a2-84429148accc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:36.806558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a90755-b9f8-4f14-a1a2-84429148accc admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:36.807320 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a90755-b9f8-4f14-a1a2-84429148accc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:36.809121 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a90755-b9f8-4f14-a1a2-84429148accc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:36.819376 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1359/2704] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:36.823887 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ea30-2010-4f10-9d4d-b7d76fc20ed4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:36.834907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6ea30-2010-4f10-9d4d-b7d76fc20ed4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:36.840365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab1bc0-7765-42a3-a18c-e1016a3f1857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:36.841249 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab1bc0-7765-42a3-a18c-e1016a3f1857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:36.841566 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab1bc0-7765-42a3-a18c-e1016a3f1857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:36.841849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab1bc0-7765-42a3-a18c-e1016a3f1857 admin admin] PATH_INFO: `/v3/projects/420bb68ee4514b19b770a1cb32231b75/users/1240be2658724a81b0b13715dc0be884/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:36.843958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab1bc0-7765-42a3-a18c-e1016a3f1857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=420bb68ee4514b19b770a1cb32231b75, user_id=1240be2658724a81b0b13715dc0be884, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:36.846602 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab1bc0-7765-42a3-a18c-e1016a3f1857 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:36.858196 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1346/2705] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:36 2022] PUT /identity/v3/projects/420bb68ee4514b19b770a1cb32231b75/users/1240be2658724a81b0b13715dc0be884/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:36.873317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee1eb-87fe-4359-92d9-dbc8ad740380 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:36.873627 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee1eb-87fe-4359-92d9-dbc8ad740380 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:36.873909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee1eb-87fe-4359-92d9-dbc8ad740380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:36.904333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-783ee1eb-87fe-4359-92d9-dbc8ad740380 None None] MFA Rules not processed for user `1240be2658724a81b0b13715dc0be884`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:36.905935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-783ee1eb-87fe-4359-92d9-dbc8ad740380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:36.928040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:36.989016 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1360/2706] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:37.000678 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab1bc0-7765-42a3-a18c-e1016a3f1857 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:37.002459 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a5ab1bc0-7765-42a3-a18c-e1016a3f1857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:37.061497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab1bc0-7765-42a3-a18c-e1016a3f1857 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:37.065177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58f16a-129e-4e47-bb94-509358511127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:37.065823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58f16a-129e-4e47-bb94-509358511127 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:37.066107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58f16a-129e-4e47-bb94-509358511127 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:37.066430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58f16a-129e-4e47-bb94-509358511127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:37.129033 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58f16a-129e-4e47-bb94-509358511127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:37.130829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58f16a-129e-4e47-bb94-509358511127 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:37.142720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1347/2707] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:38.343203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ee1eb-87fe-4359-92d9-dbc8ad740380 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:38.345314 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-783ee1eb-87fe-4359-92d9-dbc8ad740380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:38.415751 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ee1eb-87fe-4359-92d9-dbc8ad740380 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:38.420520 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:38.421539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:38.421825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:38.422098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] PATH_INFO: `/v3/users/e9d81be3acbe4e7883f218e792d37bba` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:38.423422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d81be3acbe4e7883f218e792d37bba)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:38.425337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:38.482175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd5571-ffa2-4fbd-8b9e-21801d252a4e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:38.483056 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd5571-ffa2-4fbd-8b9e-21801d252a4e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:38.483345 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd5571-ffa2-4fbd-8b9e-21801d252a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:38.501080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-88cd5571-ffa2-4fbd-8b9e-21801d252a4e None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:38.502317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-88cd5571-ffa2-4fbd-8b9e-21801d252a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:38.536585 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:38.562478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1348/2708] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 09:53:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:53:38.575265 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd5571-ffa2-4fbd-8b9e-21801d252a4e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:38.576971 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-88cd5571-ffa2-4fbd-8b9e-21801d252a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:38.631719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d81be3acbe4e7883f218e792d37bba'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:38.645401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d81be3acbe4e7883f218e792d37bba'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:38.653323 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd5571-ffa2-4fbd-8b9e-21801d252a4e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:38.658675 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6903b1-72c4-4c30-b50d-7be029d03e25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:38.659359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6903b1-72c4-4c30-b50d-7be029d03e25 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:38.659647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6903b1-72c4-4c30-b50d-7be029d03e25 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:38.659928 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6903b1-72c4-4c30-b50d-7be029d03e25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:38.668155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6903b1-72c4-4c30-b50d-7be029d03e25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:38.669746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6903b1-72c4-4c30-b50d-7be029d03e25 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:38.677792 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1349/2709] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:53:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 09:53:38.730811 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d81be3acbe4e7883f218e792d37bba'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:38.731469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d81be3acbe4e7883f218e792d37bba'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:38.739195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d81be3acbe4e7883f218e792d37bba'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:38.746877 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1361/2710] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:38 2022] DELETE /identity/v3/users/e9d81be3acbe4e7883f218e792d37bba => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:38.751245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c14c9a-b5f2-466e-af72-a7d0aa2802b4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:38.751536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c14c9a-b5f2-466e-af72-a7d0aa2802b4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:38.751881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c14c9a-b5f2-466e-af72-a7d0aa2802b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:38.770362 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c2c14c9a-b5f2-466e-af72-a7d0aa2802b4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:38.771609 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c2c14c9a-b5f2-466e-af72-a7d0aa2802b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:38.908565 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1350/2711] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:38.919354 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:38.921119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:38.969126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c14c9a-b5f2-466e-af72-a7d0aa2802b4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:38.971182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c2c14c9a-b5f2-466e-af72-a7d0aa2802b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:39.057482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:39.081635 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e1821-ccce-4867-b004-c3ae5cebfc1a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:39.086620 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd4346-23b4-47db-a5a4-4baa6908ec34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:39.090551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd4346-23b4-47db-a5a4-4baa6908ec34 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:39.090991 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd4346-23b4-47db-a5a4-4baa6908ec34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:39.092958 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd4346-23b4-47db-a5a4-4baa6908ec34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:39.113907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c14c9a-b5f2-466e-af72-a7d0aa2802b4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:39.120344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07721e3a-39eb-4117-8f64-b8e79a9406c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:39.124206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07721e3a-39eb-4117-8f64-b8e79a9406c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:39.124206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07721e3a-39eb-4117-8f64-b8e79a9406c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:39.124430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd4346-23b4-47db-a5a4-4baa6908ec34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:39.124532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07721e3a-39eb-4117-8f64-b8e79a9406c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:39.124532 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-07721e3a-39eb-4117-8f64-b8e79a9406c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:39.124681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd4346-23b4-47db-a5a4-4baa6908ec34 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:39.136989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1362/2712] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:39.166301 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:39.218582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07721e3a-39eb-4117-8f64-b8e79a9406c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:39.220322 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07721e3a-39eb-4117-8f64-b8e79a9406c8 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:39.232797 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1351/2713] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:53:39.998964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd4346-23b4-47db-a5a4-4baa6908ec34 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:40.001066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-64bd4346-23b4-47db-a5a4-4baa6908ec34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:40.017191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd4346-23b4-47db-a5a4-4baa6908ec34 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:40.022797 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:40.024744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:40.025385 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:40.025898 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] PATH_INFO: `/v3/projects/69d786cbba7646fbbb60a34c9ddb07c2` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:40.027798 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d786cbba7646fbbb60a34c9ddb07c2)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:40.030373 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:40.194384 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d786cbba7646fbbb60a34c9ddb07c2', 'request_id': 'req-53d417af-6af2-4a75-967e-2ae87631c3d7'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.285640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d786cbba7646fbbb60a34c9ddb07c2', 'request_id': 'req-53d417af-6af2-4a75-967e-2ae87631c3d7'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.295427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d786cbba7646fbbb60a34c9ddb07c2', 'request_id': 'req-53d417af-6af2-4a75-967e-2ae87631c3d7'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.321527 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] The token cache is being invalidate because project 69d786cbba7646fbbb60a34c9ddb07c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:40.321819 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.322956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.330066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1363/2714] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:39 2022] DELETE /identity/v3/projects/69d786cbba7646fbbb60a34c9ddb07c2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:40.334571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07721e3a-39eb-4117-8f64-b8e79a9406c8 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:40.357842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07721e3a-39eb-4117-8f64-b8e79a9406c8 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:40.429708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:40.431239 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:40.432378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:40.432378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] PATH_INFO: `/v3/users/c0f976da8b97471ab98036427d9a24db` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:40.434006 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f976da8b97471ab98036427d9a24db)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:40.436353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:40.705446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f976da8b97471ab98036427d9a24db'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.710828 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f976da8b97471ab98036427d9a24db'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.744494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f976da8b97471ab98036427d9a24db'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.755133 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f976da8b97471ab98036427d9a24db'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.826333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-eb2b8fba-9e52-4a65-af6a-c854ed904754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f976da8b97471ab98036427d9a24db'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:40.850599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1352/2715] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:40 2022] DELETE /identity/v3/users/c0f976da8b97471ab98036427d9a24db => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:41.421332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:41.424479 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:41.503699 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d417af-6af2-4a75-967e-2ae87631c3d7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:41.645122 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:41.645939 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:41.646226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:41.646519 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] PATH_INFO: `/v3/projects/85d142742e2a436d8c00ae0a9ae934ca` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:41.647766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d142742e2a436d8c00ae0a9ae934ca)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:41.650674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:41.828583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d142742e2a436d8c00ae0a9ae934ca', 'request_id': 'req-5510d9bb-9a9d-407a-8089-a66dbc6c067d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:41.908206 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d142742e2a436d8c00ae0a9ae934ca', 'request_id': 'req-5510d9bb-9a9d-407a-8089-a66dbc6c067d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:41.914306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:41.919785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d142742e2a436d8c00ae0a9ae934ca', 'request_id': 'req-5510d9bb-9a9d-407a-8089-a66dbc6c067d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:41.947208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] The token cache is being invalidate because project 85d142742e2a436d8c00ae0a9ae934ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:41.947208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:41.947208 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5510d9bb-9a9d-407a-8089-a66dbc6c067d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:41.955665 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1364/2716] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:41 2022] DELETE /identity/v3/projects/85d142742e2a436d8c00ae0a9ae934ca => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:41.960372 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb37b5-149e-411a-9299-6232947051b3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:41.960874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb37b5-149e-411a-9299-6232947051b3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:41.962518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb37b5-149e-411a-9299-6232947051b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:41.984628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0ffb37b5-149e-411a-9299-6232947051b3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:41.985837 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0ffb37b5-149e-411a-9299-6232947051b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:42.031595 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:42.074176 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1353/2717] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:42.082419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4274d-ba47-4dbd-be21-dad2180015fd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:42.082745 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4274d-ba47-4dbd-be21-dad2180015fd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:42.083505 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4274d-ba47-4dbd-be21-dad2180015fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:42.120643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f8d4274d-ba47-4dbd-be21-dad2180015fd None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:42.122402 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f8d4274d-ba47-4dbd-be21-dad2180015fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:42.131168 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1365/2718] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:42.135547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb37b5-149e-411a-9299-6232947051b3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:42.145751 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb37b5-149e-411a-9299-6232947051b3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:42.150950 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7232b3c-8785-4e24-b186-4c69ffdb43d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:42.151621 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7232b3c-8785-4e24-b186-4c69ffdb43d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:42.151907 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7232b3c-8785-4e24-b186-4c69ffdb43d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:42.154888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7232b3c-8785-4e24-b186-4c69ffdb43d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:42.154888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7232b3c-8785-4e24-b186-4c69ffdb43d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:53:42.154888 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7232b3c-8785-4e24-b186-4c69ffdb43d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:42.155414 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7232b3c-8785-4e24-b186-4c69ffdb43d2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:42.176972 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1354/2719] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:53:42.177191 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4274d-ba47-4dbd-be21-dad2180015fd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:42.193668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4274d-ba47-4dbd-be21-dad2180015fd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:42.207547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b14b0-49be-4a1c-b641-e8b7dd552dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:42.208480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b14b0-49be-4a1c-b641-e8b7dd552dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:42.208821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b14b0-49be-4a1c-b641-e8b7dd552dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:42.209109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b14b0-49be-4a1c-b641-e8b7dd552dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:42.209935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b14b0-49be-4a1c-b641-e8b7dd552dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:42.213444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b14b0-49be-4a1c-b641-e8b7dd552dd9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:42.271693 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1366/2720] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:42 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:53:42.276059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7232b3c-8785-4e24-b186-4c69ffdb43d2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:42.286346 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7232b3c-8785-4e24-b186-4c69ffdb43d2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:42.353351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36784a30-bba7-4300-9c76-1ed4f0e737c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:42.354292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36784a30-bba7-4300-9c76-1ed4f0e737c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:42.354653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36784a30-bba7-4300-9c76-1ed4f0e737c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:42.355083 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36784a30-bba7-4300-9c76-1ed4f0e737c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:42.356005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36784a30-bba7-4300-9c76-1ed4f0e737c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:42.358058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36784a30-bba7-4300-9c76-1ed4f0e737c1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:42.485442 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1355/2721] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:42 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:42.491802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b14b0-49be-4a1c-b641-e8b7dd552dd9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:42.501830 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b14b0-49be-4a1c-b641-e8b7dd552dd9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:42.509493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a172f9a-6015-4dbc-9fc0-97299c0cec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:42.510284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a172f9a-6015-4dbc-9fc0-97299c0cec88 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:42.510579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a172f9a-6015-4dbc-9fc0-97299c0cec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:42.510946 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a172f9a-6015-4dbc-9fc0-97299c0cec88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:42.511753 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a172f9a-6015-4dbc-9fc0-97299c0cec88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:42.513563 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a172f9a-6015-4dbc-9fc0-97299c0cec88 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:42.527022 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1367/2722] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:42.531047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36784a30-bba7-4300-9c76-1ed4f0e737c1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:42.543965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36784a30-bba7-4300-9c76-1ed4f0e737c1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:42.551446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a3289-e114-42ef-9999-fb52afe52de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:42.561126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a3289-e114-42ef-9999-fb52afe52de6 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:42.561126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a3289-e114-42ef-9999-fb52afe52de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:42.561126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a3289-e114-42ef-9999-fb52afe52de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:42.561126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a3289-e114-42ef-9999-fb52afe52de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:42.561126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a3289-e114-42ef-9999-fb52afe52de6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:42.571194 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1356/2723] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:53:42.580266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a172f9a-6015-4dbc-9fc0-97299c0cec88 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:42.594680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a172f9a-6015-4dbc-9fc0-97299c0cec88 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:42.605096 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e8946-0ce6-4179-b4c8-e3122dae04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:42.605446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8946-0ce6-4179-b4c8-e3122dae04ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:42.605744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8946-0ce6-4179-b4c8-e3122dae04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:42.606024 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e8946-0ce6-4179-b4c8-e3122dae04ba admin admin] PATH_INFO: `/v3/projects/9aebcc66e9c74fb395ba3c33fb3ad863/users/95b54bcd77cf4796942c094f6ef6a761/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:42.631344 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e8946-0ce6-4179-b4c8-e3122dae04ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aebcc66e9c74fb395ba3c33fb3ad863, user_id=95b54bcd77cf4796942c094f6ef6a761, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:42.634359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e8946-0ce6-4179-b4c8-e3122dae04ba admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:42.732914 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1368/2724] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:42 2022] PUT /identity/v3/projects/9aebcc66e9c74fb395ba3c33fb3ad863/users/95b54bcd77cf4796942c094f6ef6a761/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:42.744605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8ceb6-68db-4cfe-904e-7507d14dfc78 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:42.744900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8ceb6-68db-4cfe-904e-7507d14dfc78 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:42.745186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8ceb6-68db-4cfe-904e-7507d14dfc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:42.778246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-55f8ceb6-68db-4cfe-904e-7507d14dfc78 None None] MFA Rules not processed for user `95b54bcd77cf4796942c094f6ef6a761`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:42.779512 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-55f8ceb6-68db-4cfe-904e-7507d14dfc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:42.853463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1357/2725] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:42.858060 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e8946-0ce6-4179-b4c8-e3122dae04ba admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:42.953659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e8946-0ce6-4179-b4c8-e3122dae04ba admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:42.967971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9425f9-dab5-4fd4-8952-7974f9063fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:42.967971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9425f9-dab5-4fd4-8952-7974f9063fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:42.967971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9425f9-dab5-4fd4-8952-7974f9063fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:42.967971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9425f9-dab5-4fd4-8952-7974f9063fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:42.968579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9425f9-dab5-4fd4-8952-7974f9063fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:42.968579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9425f9-dab5-4fd4-8952-7974f9063fc4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:43.224090 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1369/2726] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:42 2022] POST /identity/v3/projects => generated 377 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:43.228245 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8ceb6-68db-4cfe-904e-7507d14dfc78 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:43.240484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8ceb6-68db-4cfe-904e-7507d14dfc78 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:43.281767 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:43.309102 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1155c-9709-4a93-812b-766b0c718565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:43.309785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1155c-9709-4a93-812b-766b0c718565 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:43.310066 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1155c-9709-4a93-812b-766b0c718565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:43.310337 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1155c-9709-4a93-812b-766b0c718565 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:43.311063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1155c-9709-4a93-812b-766b0c718565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:43.312986 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1155c-9709-4a93-812b-766b0c718565 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:43.411158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1358/2727] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:43 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:43.415846 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9425f9-dab5-4fd4-8952-7974f9063fc4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:43.426467 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9425f9-dab5-4fd4-8952-7974f9063fc4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:43.432588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2feef6-c07e-45fb-b929-3e8a51f227b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:43.433352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2feef6-c07e-45fb-b929-3e8a51f227b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:43.433707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2feef6-c07e-45fb-b929-3e8a51f227b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:43.434046 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2feef6-c07e-45fb-b929-3e8a51f227b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:43.434994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2feef6-c07e-45fb-b929-3e8a51f227b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:43.436670 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2feef6-c07e-45fb-b929-3e8a51f227b3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:43.456004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1370/2728] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:43.457579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1155c-9709-4a93-812b-766b0c718565 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:43.468403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1155c-9709-4a93-812b-766b0c718565 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:43.473246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881bd07-a9ff-4140-b3b7-26af88295194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:43.474132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881bd07-a9ff-4140-b3b7-26af88295194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:43.474412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881bd07-a9ff-4140-b3b7-26af88295194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:43.474690 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881bd07-a9ff-4140-b3b7-26af88295194 admin admin] PATH_INFO: `/v3/projects/f9ed5d3b5ea74d60a6965be3f9db3878/users/1aaeec38b74647d78b72fc4c3622c173/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:43.494660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881bd07-a9ff-4140-b3b7-26af88295194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ed5d3b5ea74d60a6965be3f9db3878, user_id=1aaeec38b74647d78b72fc4c3622c173, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:43.497584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881bd07-a9ff-4140-b3b7-26af88295194 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:43.587040 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1359/2729] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:43 2022] PUT /identity/v3/projects/f9ed5d3b5ea74d60a6965be3f9db3878/users/1aaeec38b74647d78b72fc4c3622c173/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:43.592008 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2feef6-c07e-45fb-b929-3e8a51f227b3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:43.603864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2feef6-c07e-45fb-b929-3e8a51f227b3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:43.682348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203264a-7cd6-427d-90e9-221f628a885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:43.683062 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203264a-7cd6-427d-90e9-221f628a885d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:43.683450 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203264a-7cd6-427d-90e9-221f628a885d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:43.683857 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203264a-7cd6-427d-90e9-221f628a885d admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:43.684614 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203264a-7cd6-427d-90e9-221f628a885d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:43.687124 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203264a-7cd6-427d-90e9-221f628a885d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:43.689768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:43.699331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1371/2730] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:43.703999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881bd07-a9ff-4140-b3b7-26af88295194 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:43.715192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881bd07-a9ff-4140-b3b7-26af88295194 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:43.723142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a6344-2395-4e70-ac03-8bc868b1fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:43.724080 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a6344-2395-4e70-ac03-8bc868b1fc61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:43.724369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a6344-2395-4e70-ac03-8bc868b1fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:43.724654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a6344-2395-4e70-ac03-8bc868b1fc61 admin admin] PATH_INFO: `/v3/projects/f9ed5d3b5ea74d60a6965be3f9db3878/users/1aaeec38b74647d78b72fc4c3622c173/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:43.727917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a6344-2395-4e70-ac03-8bc868b1fc61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ed5d3b5ea74d60a6965be3f9db3878, user_id=1aaeec38b74647d78b72fc4c3622c173, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:43.730369 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a6344-2395-4e70-ac03-8bc868b1fc61 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:43.742909 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1360/2731] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:43 2022] PUT /identity/v3/projects/f9ed5d3b5ea74d60a6965be3f9db3878/users/1aaeec38b74647d78b72fc4c3622c173/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:53:43.753472 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f400-9304-406f-b530-d06af61f316d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:43.753762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f400-9304-406f-b530-d06af61f316d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:43.754059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f400-9304-406f-b530-d06af61f316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:43.788769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2505f400-9304-406f-b530-d06af61f316d None None] MFA Rules not processed for user `1aaeec38b74647d78b72fc4c3622c173`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:43.791059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2505f400-9304-406f-b530-d06af61f316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:43.869575 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1372/2732] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:43.880841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a6344-2395-4e70-ac03-8bc868b1fc61 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:43.883107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-347a6344-2395-4e70-ac03-8bc868b1fc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:43.948937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a6344-2395-4e70-ac03-8bc868b1fc61 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:43.957754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb762317-8329-4099-bdf5-2e8f17996e58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:43.958550 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762317-8329-4099-bdf5-2e8f17996e58 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:43.958977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762317-8329-4099-bdf5-2e8f17996e58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:43.959363 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762317-8329-4099-bdf5-2e8f17996e58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:43.977405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505f400-9304-406f-b530-d06af61f316d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:43.978985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2505f400-9304-406f-b530-d06af61f316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:44.027817 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb762317-8329-4099-bdf5-2e8f17996e58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:44.029569 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb762317-8329-4099-bdf5-2e8f17996e58 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:44.039814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1361/2733] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:44.078431 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505f400-9304-406f-b530-d06af61f316d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:44.088469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:44.089374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:44.089662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:44.089949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] PATH_INFO: `/v3/users/a4dc2552bdc04b86b91754d6317f30b9` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:44.091204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4dc2552bdc04b86b91754d6317f30b9)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:44.093172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:44.346680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4dc2552bdc04b86b91754d6317f30b9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:44.372112 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4dc2552bdc04b86b91754d6317f30b9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:44.466433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4dc2552bdc04b86b91754d6317f30b9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:44.466433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4dc2552bdc04b86b91754d6317f30b9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:44.466433 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4dc2552bdc04b86b91754d6317f30b9'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:44.470469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1373/2734] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:43 2022] DELETE /identity/v3/users/a4dc2552bdc04b86b91754d6317f30b9 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:44.475111 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b2fe-ac98-443e-a2f8-c11429090d41 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:44.475537 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b2fe-ac98-443e-a2f8-c11429090d41 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:44.475734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4b2fe-ac98-443e-a2f8-c11429090d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:44.496065 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8cd4b2fe-ac98-443e-a2f8-c11429090d41 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:44.497513 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8cd4b2fe-ac98-443e-a2f8-c11429090d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:44.542693 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:44.587814 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1362/2735] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:44.598148 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:44.599689 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:44.606465 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:44.671331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963e590-6857-4be3-aa35-551c8aa16337 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:44.675637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f829e-1466-4e06-8335-e39faa2668a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:44.676703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f829e-1466-4e06-8335-e39faa2668a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:44.676980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f829e-1466-4e06-8335-e39faa2668a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:44.677352 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f829e-1466-4e06-8335-e39faa2668a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:44.688610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f829e-1466-4e06-8335-e39faa2668a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:44.690232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f829e-1466-4e06-8335-e39faa2668a0 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:44.702863 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1374/2736] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:45.184964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b2fe-ac98-443e-a2f8-c11429090d41 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:45.186546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8cd4b2fe-ac98-443e-a2f8-c11429090d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:45.201812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4b2fe-ac98-443e-a2f8-c11429090d41 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:45.207350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:45.208552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:45.208938 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:45.209332 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] PATH_INFO: `/v3/projects/62f03a8600e342249b630a20fe086173` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:45.210708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f03a8600e342249b630a20fe086173)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:45.212863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:45.321614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f03a8600e342249b630a20fe086173', 'request_id': 'req-2e6f03a5-c876-4da6-927f-d1b1273f01af'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.327503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f03a8600e342249b630a20fe086173', 'request_id': 'req-2e6f03a5-c876-4da6-927f-d1b1273f01af'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.404861 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f03a8600e342249b630a20fe086173', 'request_id': 'req-2e6f03a5-c876-4da6-927f-d1b1273f01af'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.418130 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] The token cache is being invalidate because project 62f03a8600e342249b630a20fe086173 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:45.418424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.419144 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.420916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1363/2737] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:45 2022] DELETE /identity/v3/projects/62f03a8600e342249b630a20fe086173 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:45.425078 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f829e-1466-4e06-8335-e39faa2668a0 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:45.436691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f829e-1466-4e06-8335-e39faa2668a0 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:45.503987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:45.505155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:45.505587 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:45.506082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] PATH_INFO: `/v3/users/1240be2658724a81b0b13715dc0be884` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:45.507599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1240be2658724a81b0b13715dc0be884)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:45.509769 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:45.734427 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1240be2658724a81b0b13715dc0be884'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.749626 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1240be2658724a81b0b13715dc0be884'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.822637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1240be2658724a81b0b13715dc0be884'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.830547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1240be2658724a81b0b13715dc0be884'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.837603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6ac66ee8-5a45-48a2-a29c-0dbcf37c92f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1240be2658724a81b0b13715dc0be884'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:45.848949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1375/2738] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:45 2022] DELETE /identity/v3/users/1240be2658724a81b0b13715dc0be884 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:46.310224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:46.311664 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:46.325721 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6f03a5-c876-4da6-927f-d1b1273f01af admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:46.400524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:46.401403 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:46.401668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:46.401937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] PATH_INFO: `/v3/projects/420bb68ee4514b19b770a1cb32231b75` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:46.403155 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=420bb68ee4514b19b770a1cb32231b75)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:46.405270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:46.504002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420bb68ee4514b19b770a1cb32231b75', 'request_id': 'req-1095ad15-729f-4144-ba23-a6c45c924928'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:46.510734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420bb68ee4514b19b770a1cb32231b75', 'request_id': 'req-1095ad15-729f-4144-ba23-a6c45c924928'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:46.576306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420bb68ee4514b19b770a1cb32231b75', 'request_id': 'req-1095ad15-729f-4144-ba23-a6c45c924928'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:46.578340 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:46.588480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] The token cache is being invalidate because project 420bb68ee4514b19b770a1cb32231b75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:46.592761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:46.592761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1095ad15-729f-4144-ba23-a6c45c924928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:46.592761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1364/2739] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:46 2022] DELETE /identity/v3/projects/420bb68ee4514b19b770a1cb32231b75 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:46.596005 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17d83b-e599-4ee7-a32b-1cf9c66a44a3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:46.596303 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17d83b-e599-4ee7-a32b-1cf9c66a44a3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:46.596588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17d83b-e599-4ee7-a32b-1cf9c66a44a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:46.615475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fb17d83b-e599-4ee7-a32b-1cf9c66a44a3 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:46.616664 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fb17d83b-e599-4ee7-a32b-1cf9c66a44a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:46.636607 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:46.677698 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1376/2740] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:46.686235 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4819189-bf28-463f-9942-06577291c0ce None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:46.686524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4819189-bf28-463f-9942-06577291c0ce None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:46.686801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4819189-bf28-463f-9942-06577291c0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:46.706998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b4819189-bf28-463f-9942-06577291c0ce None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:46.708158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b4819189-bf28-463f-9942-06577291c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:46.716663 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1365/2741] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:46.720802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17d83b-e599-4ee7-a32b-1cf9c66a44a3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:46.731593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17d83b-e599-4ee7-a32b-1cf9c66a44a3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:46.736344 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a74c-65ed-4861-8825-d91594759a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:46.737025 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a74c-65ed-4861-8825-d91594759a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:46.737361 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a74c-65ed-4861-8825-d91594759a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:46.737674 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97a74c-65ed-4861-8825-d91594759a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:46.738410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97a74c-65ed-4861-8825-d91594759a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:53:46.738719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97a74c-65ed-4861-8825-d91594759a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:46.740357 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97a74c-65ed-4861-8825-d91594759a5a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:46.756550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1377/2742] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:53:46.757583 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4819189-bf28-463f-9942-06577291c0ce None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:46.767571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4819189-bf28-463f-9942-06577291c0ce None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:46.774514 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358794-c839-4eb7-811e-5590b2c8c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:46.775463 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358794-c839-4eb7-811e-5590b2c8c8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:46.775858 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358794-c839-4eb7-811e-5590b2c8c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:46.776200 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1358794-c839-4eb7-811e-5590b2c8c8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:46.776918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1358794-c839-4eb7-811e-5590b2c8c8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:46.778826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1358794-c839-4eb7-811e-5590b2c8c8b0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:46.887694 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1366/2743] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:46 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:53:46.891324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a74c-65ed-4861-8825-d91594759a5a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:46.901525 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97a74c-65ed-4861-8825-d91594759a5a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:46.961750 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239c2f-660c-4bbf-8663-916b40a86628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:46.962504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239c2f-660c-4bbf-8663-916b40a86628 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:46.962770 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239c2f-660c-4bbf-8663-916b40a86628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:46.963052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04239c2f-660c-4bbf-8663-916b40a86628 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:46.963744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04239c2f-660c-4bbf-8663-916b40a86628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:46.965680 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04239c2f-660c-4bbf-8663-916b40a86628 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.087840 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1378/2744] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:46 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:47.090501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358794-c839-4eb7-811e-5590b2c8c8b0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.100701 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1358794-c839-4eb7-811e-5590b2c8c8b0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.107166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f3893-65f7-4027-85fc-e1ec2946c40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.107865 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3893-65f7-4027-85fc-e1ec2946c40d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.108127 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3893-65f7-4027-85fc-e1ec2946c40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.108405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f3893-65f7-4027-85fc-e1ec2946c40d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.109177 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f3893-65f7-4027-85fc-e1ec2946c40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.110785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f3893-65f7-4027-85fc-e1ec2946c40d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.122965 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1367/2745] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:47.126904 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239c2f-660c-4bbf-8663-916b40a86628 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.137157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04239c2f-660c-4bbf-8663-916b40a86628 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.142234 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547dcef-54f9-4e7e-8681-f3c8785d1ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.142928 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547dcef-54f9-4e7e-8681-f3c8785d1ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.143221 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547dcef-54f9-4e7e-8681-f3c8785d1ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.143502 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547dcef-54f9-4e7e-8681-f3c8785d1ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.144235 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547dcef-54f9-4e7e-8681-f3c8785d1ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.145910 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547dcef-54f9-4e7e-8681-f3c8785d1ef4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.157596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1379/2746] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:53:47.161585 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f3893-65f7-4027-85fc-e1ec2946c40d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.172324 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f3893-65f7-4027-85fc-e1ec2946c40d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.177642 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d5481-61f3-4f3c-9a06-193fc4109d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.178525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d5481-61f3-4f3c-9a06-193fc4109d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.178812 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d5481-61f3-4f3c-9a06-193fc4109d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.179120 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d5481-61f3-4f3c-9a06-193fc4109d5e admin admin] PATH_INFO: `/v3/projects/c70e061068f94c36998a0682988cddb3/users/c274b29a4ec7479c98a2e60f81e996be/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.194798 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d5481-61f3-4f3c-9a06-193fc4109d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70e061068f94c36998a0682988cddb3, user_id=c274b29a4ec7479c98a2e60f81e996be, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.197789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d5481-61f3-4f3c-9a06-193fc4109d5e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.256524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1368/2747] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:47 2022] PUT /identity/v3/projects/c70e061068f94c36998a0682988cddb3/users/c274b29a4ec7479c98a2e60f81e996be/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:47.268117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c91c1-cbc4-4239-bfc5-c838f70a4784 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.268407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c91c1-cbc4-4239-bfc5-c838f70a4784 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.268682 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c91c1-cbc4-4239-bfc5-c838f70a4784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.299825 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a12c91c1-cbc4-4239-bfc5-c838f70a4784 None None] MFA Rules not processed for user `c274b29a4ec7479c98a2e60f81e996be`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:47.301043 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a12c91c1-cbc4-4239-bfc5-c838f70a4784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:47.369146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1380/2748] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:47.373833 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d5481-61f3-4f3c-9a06-193fc4109d5e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.408493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c91c1-cbc4-4239-bfc5-c838f70a4784 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.412214 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a12c91c1-cbc4-4239-bfc5-c838f70a4784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:47.447108 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d5481-61f3-4f3c-9a06-193fc4109d5e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.452107 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884eb038-4d7c-48da-a94a-cdf0504f11ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.452771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884eb038-4d7c-48da-a94a-cdf0504f11ce admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.453105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884eb038-4d7c-48da-a94a-cdf0504f11ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.453396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884eb038-4d7c-48da-a94a-cdf0504f11ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.454109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884eb038-4d7c-48da-a94a-cdf0504f11ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.456104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884eb038-4d7c-48da-a94a-cdf0504f11ce admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.479846 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c91c1-cbc4-4239-bfc5-c838f70a4784 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.483645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f17a3c-d5a3-4a50-8659-8efe64e2d1fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.484691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f17a3c-d5a3-4a50-8659-8efe64e2d1fd service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.484691 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f17a3c-d5a3-4a50-8659-8efe64e2d1fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.484926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f17a3c-d5a3-4a50-8659-8efe64e2d1fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.486641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d9f17a3c-d5a3-4a50-8659-8efe64e2d1fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:47.533756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1369/2749] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:47 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:47.537958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884eb038-4d7c-48da-a94a-cdf0504f11ce admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.552308 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f17a3c-d5a3-4a50-8659-8efe64e2d1fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.557832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f17a3c-d5a3-4a50-8659-8efe64e2d1fd service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.564331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1381/2750] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:47.599892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:47.604254 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884eb038-4d7c-48da-a94a-cdf0504f11ce admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.609075 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d427b-100c-4647-9d20-b0e564d206de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.609672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d427b-100c-4647-9d20-b0e564d206de admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.609960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d427b-100c-4647-9d20-b0e564d206de admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.610240 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d427b-100c-4647-9d20-b0e564d206de admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.610974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d427b-100c-4647-9d20-b0e564d206de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.612925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d427b-100c-4647-9d20-b0e564d206de admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.678762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1370/2751] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:47 2022] POST /identity/v3/users => generated 302 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:47.681810 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f17a3c-d5a3-4a50-8659-8efe64e2d1fd service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.693692 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f17a3c-d5a3-4a50-8659-8efe64e2d1fd service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.698732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9def-7a95-40b5-8fa0-bbce861e75a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.699447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9def-7a95-40b5-8fa0-bbce861e75a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.699771 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9def-7a95-40b5-8fa0-bbce861e75a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.705140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a9def-7a95-40b5-8fa0-bbce861e75a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.705140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a9def-7a95-40b5-8fa0-bbce861e75a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.705140 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a9def-7a95-40b5-8fa0-bbce861e75a4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.716460 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1382/2752] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:47.717592 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d427b-100c-4647-9d20-b0e564d206de admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.729104 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d427b-100c-4647-9d20-b0e564d206de admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.733759 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3ae8c-6956-46de-b44b-65bb45d7ba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.734650 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ae8c-6956-46de-b44b-65bb45d7ba20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.735005 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ae8c-6956-46de-b44b-65bb45d7ba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.735285 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ae8c-6956-46de-b44b-65bb45d7ba20 admin admin] PATH_INFO: `/v3/projects/d59de2810d0f40f4aff89fea7f5abc42/users/f26f8943e90840028fecf870fa5b8278/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.737622 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:47.751213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3ae8c-6956-46de-b44b-65bb45d7ba20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59de2810d0f40f4aff89fea7f5abc42, user_id=f26f8943e90840028fecf870fa5b8278, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.754025 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3ae8c-6956-46de-b44b-65bb45d7ba20 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.851344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1371/2753] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:47 2022] PUT /identity/v3/projects/d59de2810d0f40f4aff89fea7f5abc42/users/f26f8943e90840028fecf870fa5b8278/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:47.855755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9def-7a95-40b5-8fa0-bbce861e75a4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.865637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a9def-7a95-40b5-8fa0-bbce861e75a4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.930781 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c48c-27fc-4572-bd52-6f1900d0cfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.931435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c48c-27fc-4572-bd52-6f1900d0cfdf admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.931720 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c48c-27fc-4572-bd52-6f1900d0cfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.932017 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c48c-27fc-4572-bd52-6f1900d0cfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.932778 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9c48c-27fc-4572-bd52-6f1900d0cfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.934367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9c48c-27fc-4572-bd52-6f1900d0cfdf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.948672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1383/2754] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:47.949845 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3ae8c-6956-46de-b44b-65bb45d7ba20 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:47.960744 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3ae8c-6956-46de-b44b-65bb45d7ba20 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:47.965879 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda64c2-115c-4062-9d7a-b7770f024050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:47.966771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda64c2-115c-4062-9d7a-b7770f024050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.967084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda64c2-115c-4062-9d7a-b7770f024050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.967360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda64c2-115c-4062-9d7a-b7770f024050 admin admin] PATH_INFO: `/v3/projects/d59de2810d0f40f4aff89fea7f5abc42/users/f26f8943e90840028fecf870fa5b8278/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:47.969384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda64c2-115c-4062-9d7a-b7770f024050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59de2810d0f40f4aff89fea7f5abc42, user_id=f26f8943e90840028fecf870fa5b8278, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:47.972058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda64c2-115c-4062-9d7a-b7770f024050 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:47.982794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1372/2755] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:47 2022] PUT /identity/v3/projects/d59de2810d0f40f4aff89fea7f5abc42/users/f26f8943e90840028fecf870fa5b8278/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:47.993738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e752de-0fe0-471f-b3c2-cc2316193b4a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:47.994473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e752de-0fe0-471f-b3c2-cc2316193b4a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:47.994473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e752de-0fe0-471f-b3c2-cc2316193b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:48.021679 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-87e752de-0fe0-471f-b3c2-cc2316193b4a None None] MFA Rules not processed for user `f26f8943e90840028fecf870fa5b8278`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:48.022927 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-87e752de-0fe0-471f-b3c2-cc2316193b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:48.071222 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:48.095569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1384/2756] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:53:48.106885 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda64c2-115c-4062-9d7a-b7770f024050 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:48.108571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ffda64c2-115c-4062-9d7a-b7770f024050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:48.171864 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda64c2-115c-4062-9d7a-b7770f024050 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:48.175900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2b982-b1e7-4a81-b184-acacc5994573 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:48.176560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2b982-b1e7-4a81-b184-acacc5994573 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:48.176999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2b982-b1e7-4a81-b184-acacc5994573 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:48.177773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2b982-b1e7-4a81-b184-acacc5994573 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:48.187783 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2b982-b1e7-4a81-b184-acacc5994573 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:48.189157 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2b982-b1e7-4a81-b184-acacc5994573 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:48.198962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1373/2757] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:48.291004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e752de-0fe0-471f-b3c2-cc2316193b4a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:48.291004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e752de-0fe0-471f-b3c2-cc2316193b4a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:48.291004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2959f3f-42b6-4df9-9720-2eadc581985d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:48.291004 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2959f3f-42b6-4df9-9720-2eadc581985d service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:48.292469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2959f3f-42b6-4df9-9720-2eadc581985d service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:48.292469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2959f3f-42b6-4df9-9720-2eadc581985d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:48.331591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2959f3f-42b6-4df9-9720-2eadc581985d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:48.333203 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2959f3f-42b6-4df9-9720-2eadc581985d service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:48.344735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1385/2758] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:53.711921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2b982-b1e7-4a81-b184-acacc5994573 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:53.781229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2b982-b1e7-4a81-b184-acacc5994573 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:53.785939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:53.786819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:53.787136 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:53.787417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] PATH_INFO: `/v3/users/c274b29a4ec7479c98a2e60f81e996be` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:53.788628 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c274b29a4ec7479c98a2e60f81e996be)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:53.790732 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:53.990494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c274b29a4ec7479c98a2e60f81e996be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:53.991140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c274b29a4ec7479c98a2e60f81e996be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:54.004896 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c274b29a4ec7479c98a2e60f81e996be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:54.013035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c274b29a4ec7479c98a2e60f81e996be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:54.014871 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:54.112877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c274b29a4ec7479c98a2e60f81e996be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:54.120023 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1374/2759] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:53 2022] DELETE /identity/v3/users/c274b29a4ec7479c98a2e60f81e996be => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:54.125591 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50b6b-33a7-4fce-a522-fdbb9bed019a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:54.126058 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50b6b-33a7-4fce-a522-fdbb9bed019a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:54.126178 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50b6b-33a7-4fce-a522-fdbb9bed019a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:54.144075 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bcf50b6b-33a7-4fce-a522-fdbb9bed019a None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:54.145279 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bcf50b6b-33a7-4fce-a522-fdbb9bed019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:54.205475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1386/2760] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:54.215765 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:54.217183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:54.276832 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e7f63-f57d-470a-a613-5398d415e462 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:54.280573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe908b28-d99f-49c1-a3af-5ef78227be87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:54.281222 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe908b28-d99f-49c1-a3af-5ef78227be87 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:54.281503 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe908b28-d99f-49c1-a3af-5ef78227be87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:54.281778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe908b28-d99f-49c1-a3af-5ef78227be87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:54.291845 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe908b28-d99f-49c1-a3af-5ef78227be87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:54.293268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe908b28-d99f-49c1-a3af-5ef78227be87 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:54.302805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1375/2761] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:54.725895 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf50b6b-33a7-4fce-a522-fdbb9bed019a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:54.728650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bcf50b6b-33a7-4fce-a522-fdbb9bed019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:54.740707 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf50b6b-33a7-4fce-a522-fdbb9bed019a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:54.746188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:54.749801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:54.750172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:54.750471 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] PATH_INFO: `/v3/projects/c70e061068f94c36998a0682988cddb3` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:54.751849 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70e061068f94c36998a0682988cddb3)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:54.757999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:54.873821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70e061068f94c36998a0682988cddb3', 'request_id': 'req-a21a93f3-645e-4427-85e3-a452883eead1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:54.987600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70e061068f94c36998a0682988cddb3', 'request_id': 'req-a21a93f3-645e-4427-85e3-a452883eead1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:54.995794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70e061068f94c36998a0682988cddb3', 'request_id': 'req-a21a93f3-645e-4427-85e3-a452883eead1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:55.008760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] The token cache is being invalidate because project c70e061068f94c36998a0682988cddb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:55.009057 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:55.009732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:55.011330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1387/2762] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:54 2022] DELETE /identity/v3/projects/c70e061068f94c36998a0682988cddb3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:55.015320 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe908b28-d99f-49c1-a3af-5ef78227be87 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:55.025908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe908b28-d99f-49c1-a3af-5ef78227be87 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:55.081447 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:55.082260 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:55.082548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:55.082829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] PATH_INFO: `/v3/users/f26f8943e90840028fecf870fa5b8278` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:55.088843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26f8943e90840028fecf870fa5b8278)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:55.088843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:55.310461 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26f8943e90840028fecf870fa5b8278'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:55.311164 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26f8943e90840028fecf870fa5b8278'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:55.324329 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26f8943e90840028fecf870fa5b8278'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:55.331038 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26f8943e90840028fecf870fa5b8278'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:55.450734 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2dad700f-9edf-4e3a-9712-4d09c8573c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26f8943e90840028fecf870fa5b8278'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:55.457419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1376/2763] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:53:55 2022] DELETE /identity/v3/users/f26f8943e90840028fecf870fa5b8278 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:55.886104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:55.887579 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:55.895987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:55.901950 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a93f3-645e-4427-85e3-a452883eead1 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:55.960558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:55.961848 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:55.962125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:55.962401 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] PATH_INFO: `/v3/projects/d59de2810d0f40f4aff89fea7f5abc42` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:55.963619 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59de2810d0f40f4aff89fea7f5abc42)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:55.965542 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:56.085021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59de2810d0f40f4aff89fea7f5abc42', 'request_id': 'req-76830b2d-94ac-4366-9e12-fac4942339b4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:56.141982 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59de2810d0f40f4aff89fea7f5abc42', 'request_id': 'req-76830b2d-94ac-4366-9e12-fac4942339b4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:56.147957 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59de2810d0f40f4aff89fea7f5abc42', 'request_id': 'req-76830b2d-94ac-4366-9e12-fac4942339b4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:56.160102 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] The token cache is being invalidate because project d59de2810d0f40f4aff89fea7f5abc42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:53:56.160388 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:56.161012 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-76830b2d-94ac-4366-9e12-fac4942339b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:53:56.162544 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1388/2764] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:53:55 2022] DELETE /identity/v3/projects/d59de2810d0f40f4aff89fea7f5abc42 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:56.175159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029163-aa2e-4a7d-a38e-5dedcbf10aeb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.175715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029163-aa2e-4a7d-a38e-5dedcbf10aeb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.175821 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029163-aa2e-4a7d-a38e-5dedcbf10aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.194952 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-47029163-aa2e-4a7d-a38e-5dedcbf10aeb None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:56.196215 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-47029163-aa2e-4a7d-a38e-5dedcbf10aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:56.205097 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:56.257491 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1377/2765] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:56.265449 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01814a-d699-4158-87c4-ab86c9a379ff None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.265836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01814a-d699-4158-87c4-ab86c9a379ff None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.266372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01814a-d699-4158-87c4-ab86c9a379ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.287909 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2d01814a-d699-4158-87c4-ab86c9a379ff None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:56.289735 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2d01814a-d699-4158-87c4-ab86c9a379ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:56.298076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1389/2766] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:56.302452 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47029163-aa2e-4a7d-a38e-5dedcbf10aeb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:56.312510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47029163-aa2e-4a7d-a38e-5dedcbf10aeb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:56.318660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd699be0-d836-4d65-8670-ea807d895567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:56.319469 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd699be0-d836-4d65-8670-ea807d895567 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.319900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd699be0-d836-4d65-8670-ea807d895567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.320953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd699be0-d836-4d65-8670-ea807d895567 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.321752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd699be0-d836-4d65-8670-ea807d895567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:53:56.322142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd699be0-d836-4d65-8670-ea807d895567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:56.323919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd699be0-d836-4d65-8670-ea807d895567 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:56.341534 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1378/2767] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:53:56.342732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01814a-d699-4158-87c4-ab86c9a379ff None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:56.352913 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01814a-d699-4158-87c4-ab86c9a379ff None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:56.357943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444eb8da-861e-4f91-bdfe-20ecb695ed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:56.358596 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444eb8da-861e-4f91-bdfe-20ecb695ed12 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.358905 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444eb8da-861e-4f91-bdfe-20ecb695ed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.359187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444eb8da-861e-4f91-bdfe-20ecb695ed12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.359872 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444eb8da-861e-4f91-bdfe-20ecb695ed12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:56.361934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444eb8da-861e-4f91-bdfe-20ecb695ed12 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:56.473896 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1390/2768] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:56 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:56.475288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd699be0-d836-4d65-8670-ea807d895567 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:56.485958 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd699be0-d836-4d65-8670-ea807d895567 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:56.546714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bcf13-5314-4c53-afc2-4e358aca30c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:56.547422 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bcf13-5314-4c53-afc2-4e358aca30c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.547706 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bcf13-5314-4c53-afc2-4e358aca30c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.547989 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bcf13-5314-4c53-afc2-4e358aca30c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.548677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bcf13-5314-4c53-afc2-4e358aca30c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:56.550627 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62bcf13-5314-4c53-afc2-4e358aca30c7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:56.628620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1379/2769] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:56 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:56.629128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444eb8da-861e-4f91-bdfe-20ecb695ed12 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:56.640129 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444eb8da-861e-4f91-bdfe-20ecb695ed12 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:56.645076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f573f20-840d-449a-b3f4-5caa55d482cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:56.645737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f573f20-840d-449a-b3f4-5caa55d482cd admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.650558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f573f20-840d-449a-b3f4-5caa55d482cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.650558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f573f20-840d-449a-b3f4-5caa55d482cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.650558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f573f20-840d-449a-b3f4-5caa55d482cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:56.650558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f573f20-840d-449a-b3f4-5caa55d482cd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:56.660803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1391/2770] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:56.665397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bcf13-5314-4c53-afc2-4e358aca30c7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:56.676947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bcf13-5314-4c53-afc2-4e358aca30c7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:56.683298 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e1e66-9ee3-4f3a-b9af-96008c15c514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:56.690546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1e66-9ee3-4f3a-b9af-96008c15c514 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.690546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1e66-9ee3-4f3a-b9af-96008c15c514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.690546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e1e66-9ee3-4f3a-b9af-96008c15c514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.690546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e1e66-9ee3-4f3a-b9af-96008c15c514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:56.690546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e1e66-9ee3-4f3a-b9af-96008c15c514 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:56.698525 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1380/2771] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:56.702754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f573f20-840d-449a-b3f4-5caa55d482cd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:56.712901 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f573f20-840d-449a-b3f4-5caa55d482cd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:56.717637 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04948c-40b1-4612-b337-badd3e338adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:56.718513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04948c-40b1-4612-b337-badd3e338adf admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.718795 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04948c-40b1-4612-b337-badd3e338adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.719128 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04948c-40b1-4612-b337-badd3e338adf admin admin] PATH_INFO: `/v3/projects/61e51347e55c4460a8105a0c99856942/users/5d5579601a9a4fa0bbc6d8f0ce076c30/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.734648 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04948c-40b1-4612-b337-badd3e338adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e51347e55c4460a8105a0c99856942, user_id=5d5579601a9a4fa0bbc6d8f0ce076c30, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:56.737501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04948c-40b1-4612-b337-badd3e338adf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:56.800269 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1392/2772] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:56 2022] PUT /identity/v3/projects/61e51347e55c4460a8105a0c99856942/users/5d5579601a9a4fa0bbc6d8f0ce076c30/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:53:56.812034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434023-a38d-4931-9a20-5819d870e3c3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.812328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434023-a38d-4931-9a20-5819d870e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.812614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb434023-a38d-4931-9a20-5819d870e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.841079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fb434023-a38d-4931-9a20-5819d870e3c3 None None] MFA Rules not processed for user `5d5579601a9a4fa0bbc6d8f0ce076c30`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:56.842382 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fb434023-a38d-4931-9a20-5819d870e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:56.908842 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1381/2773] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:56.913652 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04948c-40b1-4612-b337-badd3e338adf admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:56.947360 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:56.978138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04948c-40b1-4612-b337-badd3e338adf admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:56.982883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74769b56-5864-4ca9-a002-7673cea3a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:56.983555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74769b56-5864-4ca9-a002-7673cea3a4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:56.983848 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74769b56-5864-4ca9-a002-7673cea3a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:56.984131 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74769b56-5864-4ca9-a002-7673cea3a4b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:56.984860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74769b56-5864-4ca9-a002-7673cea3a4b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:56.986767 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74769b56-5864-4ca9-a002-7673cea3a4b7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:57.058101 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1393/2774] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:53:56 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:57.062142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb434023-a38d-4931-9a20-5819d870e3c3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:57.072853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb434023-a38d-4931-9a20-5819d870e3c3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:57.077714 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:57.129179 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d639f6-b69e-427b-be0e-8b38d1a90e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:57.129856 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d639f6-b69e-427b-be0e-8b38d1a90e43 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:57.130146 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d639f6-b69e-427b-be0e-8b38d1a90e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:57.130429 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d639f6-b69e-427b-be0e-8b38d1a90e43 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:57.131434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d639f6-b69e-427b-be0e-8b38d1a90e43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:57.133370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d639f6-b69e-427b-be0e-8b38d1a90e43 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:57.237651 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1382/2775] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:53:57 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:53:57.241649 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74769b56-5864-4ca9-a002-7673cea3a4b7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:57.252858 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74769b56-5864-4ca9-a002-7673cea3a4b7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:57.257513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be632b-b11d-44d0-9f06-2798ad8663f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:57.258193 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be632b-b11d-44d0-9f06-2798ad8663f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:57.258453 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be632b-b11d-44d0-9f06-2798ad8663f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:57.258734 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be632b-b11d-44d0-9f06-2798ad8663f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:57.259497 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be632b-b11d-44d0-9f06-2798ad8663f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:57.261086 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be632b-b11d-44d0-9f06-2798ad8663f2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:57.271736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1394/2776] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:57.275951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d639f6-b69e-427b-be0e-8b38d1a90e43 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:57.286014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d639f6-b69e-427b-be0e-8b38d1a90e43 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:57.300396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4e59-3fb7-4543-8c47-4213d15a01c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:57.300396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a4e59-3fb7-4543-8c47-4213d15a01c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:57.300396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a4e59-3fb7-4543-8c47-4213d15a01c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:57.300396 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a4e59-3fb7-4543-8c47-4213d15a01c9 admin admin] PATH_INFO: `/v3/projects/ccd304086bc048dc8c989942ad22eb62/users/87afd3ae184944b5ba16d3ac60a902e3/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:57.308813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a4e59-3fb7-4543-8c47-4213d15a01c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd304086bc048dc8c989942ad22eb62, user_id=87afd3ae184944b5ba16d3ac60a902e3, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:57.311424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a4e59-3fb7-4543-8c47-4213d15a01c9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:57.381949 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1383/2777] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:57 2022] PUT /identity/v3/projects/ccd304086bc048dc8c989942ad22eb62/users/87afd3ae184944b5ba16d3ac60a902e3/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:57.390672 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be632b-b11d-44d0-9f06-2798ad8663f2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:57.401703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be632b-b11d-44d0-9f06-2798ad8663f2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:57.461391 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6a4f8-d8b7-4ea0-abfc-6660df1141e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:57.462580 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6a4f8-d8b7-4ea0-abfc-6660df1141e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:57.462885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6a4f8-d8b7-4ea0-abfc-6660df1141e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:57.463212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6a4f8-d8b7-4ea0-abfc-6660df1141e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:57.463885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6a4f8-d8b7-4ea0-abfc-6660df1141e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:57.465447 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6a4f8-d8b7-4ea0-abfc-6660df1141e2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:57.475606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1395/2778] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:53:57.480680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4e59-3fb7-4543-8c47-4213d15a01c9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:57.491154 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a4e59-3fb7-4543-8c47-4213d15a01c9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:57.495977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8379358-2259-4121-af22-8a2ec702cf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:57.496873 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8379358-2259-4121-af22-8a2ec702cf7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:57.497178 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8379358-2259-4121-af22-8a2ec702cf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:57.497464 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8379358-2259-4121-af22-8a2ec702cf7f admin admin] PATH_INFO: `/v3/projects/ccd304086bc048dc8c989942ad22eb62/users/87afd3ae184944b5ba16d3ac60a902e3/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:57.499461 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8379358-2259-4121-af22-8a2ec702cf7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd304086bc048dc8c989942ad22eb62, user_id=87afd3ae184944b5ba16d3ac60a902e3, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:57.502132 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8379358-2259-4121-af22-8a2ec702cf7f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:57.512657 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1384/2779] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:53:57 2022] PUT /identity/v3/projects/ccd304086bc048dc8c989942ad22eb62/users/87afd3ae184944b5ba16d3ac60a902e3/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:53:57.523773 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375380cf-4b2a-4ec7-b4ff-bc249808d5b4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:57.524246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375380cf-4b2a-4ec7-b4ff-bc249808d5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:57.524246 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375380cf-4b2a-4ec7-b4ff-bc249808d5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:57.552175 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-375380cf-4b2a-4ec7-b4ff-bc249808d5b4 None None] MFA Rules not processed for user `87afd3ae184944b5ba16d3ac60a902e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:53:57.553428 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-375380cf-4b2a-4ec7-b4ff-bc249808d5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:57.624923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1396/2780] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:53:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:53:57.635859 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8379358-2259-4121-af22-8a2ec702cf7f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:57.637633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b8379358-2259-4121-af22-8a2ec702cf7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:57.696770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8379358-2259-4121-af22-8a2ec702cf7f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:57.700417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da686baa-a97b-4f8f-b7e1-6a153b2bbf41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:57.704112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686baa-a97b-4f8f-b7e1-6a153b2bbf41 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:57.704112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686baa-a97b-4f8f-b7e1-6a153b2bbf41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:57.704112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da686baa-a97b-4f8f-b7e1-6a153b2bbf41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:57.759851 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da686baa-a97b-4f8f-b7e1-6a153b2bbf41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:53:57.761303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da686baa-a97b-4f8f-b7e1-6a153b2bbf41 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:53:57.770519 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1385/2781] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:53:59.866816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375380cf-4b2a-4ec7-b4ff-bc249808d5b4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:53:59.868276 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-375380cf-4b2a-4ec7-b4ff-bc249808d5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:53:59.910772 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:59.944874 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375380cf-4b2a-4ec7-b4ff-bc249808d5b4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:53:59.949487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2545f-c266-47c0-879a-6b7344bcee11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:53:59.950920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2545f-c266-47c0-879a-6b7344bcee11 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:53:59.950920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2545f-c266-47c0-879a-6b7344bcee11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:53:59.950920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2545f-c266-47c0-879a-6b7344bcee11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:53:59.952572 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8eb2545f-c266-47c0-879a-6b7344bcee11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:00.016417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2545f-c266-47c0-879a-6b7344bcee11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:00.017997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2545f-c266-47c0-879a-6b7344bcee11 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:00.028277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1397/2782] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:53:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:00.972874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da686baa-a97b-4f8f-b7e1-6a153b2bbf41 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:00.990487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:01.036916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da686baa-a97b-4f8f-b7e1-6a153b2bbf41 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:01.042197 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:01.043114 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:01.043401 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:01.043683 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] PATH_INFO: `/v3/users/5d5579601a9a4fa0bbc6d8f0ce076c30` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:01.044875 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5579601a9a4fa0bbc6d8f0ce076c30)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:01.046857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:01.200024 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5579601a9a4fa0bbc6d8f0ce076c30'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:01.200756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5579601a9a4fa0bbc6d8f0ce076c30'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:01.214615 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5579601a9a4fa0bbc6d8f0ce076c30'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:01.221968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5579601a9a4fa0bbc6d8f0ce076c30'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:01.278955 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5579601a9a4fa0bbc6d8f0ce076c30'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:01.285745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1386/2783] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:00 2022] DELETE /identity/v3/users/5d5579601a9a4fa0bbc6d8f0ce076c30 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:01.290335 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336e078-fec9-4466-bd88-4a240987f3fd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:01.291960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336e078-fec9-4466-bd88-4a240987f3fd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:01.292257 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336e078-fec9-4466-bd88-4a240987f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:01.309543 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7336e078-fec9-4466-bd88-4a240987f3fd None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:01.310809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7336e078-fec9-4466-bd88-4a240987f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:01.372601 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1398/2784] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:01.393457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:01.395299 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:01.477567 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829c74-5c1a-455c-ac3d-7572de626846 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:01.479922 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2856e94-5eda-470f-b72d-70a947e2b56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:01.480910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2856e94-5eda-470f-b72d-70a947e2b56b service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:01.480910 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2856e94-5eda-470f-b72d-70a947e2b56b service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:01.481326 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2856e94-5eda-470f-b72d-70a947e2b56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:01.492088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2856e94-5eda-470f-b72d-70a947e2b56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:01.494370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2856e94-5eda-470f-b72d-70a947e2b56b service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:01.505895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1387/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:02.339544 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336e078-fec9-4466-bd88-4a240987f3fd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:02.341965 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7336e078-fec9-4466-bd88-4a240987f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:02.358111 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336e078-fec9-4466-bd88-4a240987f3fd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:02.363777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:02.364659 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:02.364943 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:02.365306 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] PATH_INFO: `/v3/projects/61e51347e55c4460a8105a0c99856942` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:02.366684 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e51347e55c4460a8105a0c99856942)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:02.369445 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:02.387559 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2856e94-5eda-470f-b72d-70a947e2b56b service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:02.390620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c2856e94-5eda-470f-b72d-70a947e2b56b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:02.439267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:02.472028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2856e94-5eda-470f-b72d-70a947e2b56b service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:02.477696 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5b9c1-f99f-4320-a719-2c83bf76327e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0422e6863c7147b79ea4d194e6e07154', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:02.478912 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5b9c1-f99f-4320-a719-2c83bf76327e service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:02.479204 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5b9c1-f99f-4320-a719-2c83bf76327e service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:02.479504 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5b9c1-f99f-4320-a719-2c83bf76327e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:02.481466 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7dd5b9c1-f99f-4320-a719-2c83bf76327e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:02.494940 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5b9c1-f99f-4320-a719-2c83bf76327e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:02.496552 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5b9c1-f99f-4320-a719-2c83bf76327e service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:02.508230 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1388/2786] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:54:02.557442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e51347e55c4460a8105a0c99856942', 'request_id': 'req-a417ac21-2086-4bb5-b597-f5e597764f34'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:02.644541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e51347e55c4460a8105a0c99856942', 'request_id': 'req-a417ac21-2086-4bb5-b597-f5e597764f34'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:02.653641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e51347e55c4460a8105a0c99856942', 'request_id': 'req-a417ac21-2086-4bb5-b597-f5e597764f34'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:02.663146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:02.668601 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] The token cache is being invalidate because project 61e51347e55c4460a8105a0c99856942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:02.668892 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:02.669558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:02.671245 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1399/2787] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:02 2022] DELETE /identity/v3/projects/61e51347e55c4460a8105a0c99856942 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:02.675410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5b9c1-f99f-4320-a719-2c83bf76327e service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:02.687258 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5b9c1-f99f-4320-a719-2c83bf76327e service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:02.799879 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:02.800858 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:02.801214 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:02.801596 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] PATH_INFO: `/v3/users/87afd3ae184944b5ba16d3ac60a902e3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:02.803201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87afd3ae184944b5ba16d3ac60a902e3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:02.805221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:03.029539 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87afd3ae184944b5ba16d3ac60a902e3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.030404 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87afd3ae184944b5ba16d3ac60a902e3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.052351 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87afd3ae184944b5ba16d3ac60a902e3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.061894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87afd3ae184944b5ba16d3ac60a902e3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.159167 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-89483795-a340-44fe-b1c6-a5fc78bb3b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87afd3ae184944b5ba16d3ac60a902e3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.167010 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1389/2788] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:02 2022] DELETE /identity/v3/users/87afd3ae184944b5ba16d3ac60a902e3 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:03.663633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:03.664972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:03.678442 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417ac21-2086-4bb5-b597-f5e597764f34 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:03.738331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:03.739224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:03.739514 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:03.739791 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] PATH_INFO: `/v3/projects/ccd304086bc048dc8c989942ad22eb62` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:03.741059 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd304086bc048dc8c989942ad22eb62)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:03.742987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:03.856307 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd304086bc048dc8c989942ad22eb62', 'request_id': 'req-1669ab77-bd66-4ec7-abba-395733945399'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.928880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd304086bc048dc8c989942ad22eb62', 'request_id': 'req-1669ab77-bd66-4ec7-abba-395733945399'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.936409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd304086bc048dc8c989942ad22eb62', 'request_id': 'req-1669ab77-bd66-4ec7-abba-395733945399'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.948981 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] The token cache is being invalidate because project ccd304086bc048dc8c989942ad22eb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:03.949261 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.949894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:03.951606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1400/2789] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:03 2022] DELETE /identity/v3/projects/ccd304086bc048dc8c989942ad22eb62 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:03.956599 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9cf4b-e13c-4a1c-ae47-a9eec9787c94 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:03.957078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9cf4b-e13c-4a1c-ae47-a9eec9787c94 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:03.957225 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9cf4b-e13c-4a1c-ae47-a9eec9787c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:03.976437 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0bc9cf4b-e13c-4a1c-ae47-a9eec9787c94 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:03.977881 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0bc9cf4b-e13c-4a1c-ae47-a9eec9787c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:04.008333 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:04.010796 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:04.021182 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:04.047524 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1390/2790] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:54:04.055271 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2145725-f565-42f9-a4e7-9bb4a66aafe1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.055576 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2145725-f565-42f9-a4e7-9bb4a66aafe1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.055959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2145725-f565-42f9-a4e7-9bb4a66aafe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.077241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f2145725-f565-42f9-a4e7-9bb4a66aafe1 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:04.077828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669ab77-bd66-4ec7-abba-395733945399 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:04.078502 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f2145725-f565-42f9-a4e7-9bb4a66aafe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:04.082493 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:04.083406 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.083694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.083979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] PATH_INFO: `/v3/users/95b54bcd77cf4796942c094f6ef6a761` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.085173 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95b54bcd77cf4796942c094f6ef6a761)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:04.086548 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1391/2791] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:54:04.087116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:04.090918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2145725-f565-42f9-a4e7-9bb4a66aafe1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:04.099824 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2145725-f565-42f9-a4e7-9bb4a66aafe1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:04.105183 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66814223-cb18-4d0f-9782-83254409ce1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:04.105943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66814223-cb18-4d0f-9782-83254409ce1e admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.106224 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66814223-cb18-4d0f-9782-83254409ce1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.106551 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66814223-cb18-4d0f-9782-83254409ce1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.107264 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66814223-cb18-4d0f-9782-83254409ce1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:54:04.107571 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66814223-cb18-4d0f-9782-83254409ce1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:04.109161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66814223-cb18-4d0f-9782-83254409ce1e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:04.122742 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1392/2792] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:54:04.127246 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66814223-cb18-4d0f-9782-83254409ce1e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:04.136796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66814223-cb18-4d0f-9782-83254409ce1e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:04.142068 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd1089-add0-4aba-b19b-c90175ab97cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:04.142727 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd1089-add0-4aba-b19b-c90175ab97cd admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.143047 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd1089-add0-4aba-b19b-c90175ab97cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.143326 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd1089-add0-4aba-b19b-c90175ab97cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.144018 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd1089-add0-4aba-b19b-c90175ab97cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:04.145996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd1089-add0-4aba-b19b-c90175ab97cd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:04.230446 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1393/2793] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:54:04 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:54:04.234506 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd1089-add0-4aba-b19b-c90175ab97cd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:04.295381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd1089-add0-4aba-b19b-c90175ab97cd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:04.300357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9da22-00bf-4034-a669-bdbeb25b8ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:04.301073 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9da22-00bf-4034-a669-bdbeb25b8ead admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.301405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9da22-00bf-4034-a669-bdbeb25b8ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.301746 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9da22-00bf-4034-a669-bdbeb25b8ead admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.303354 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9da22-00bf-4034-a669-bdbeb25b8ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:04.305924 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9da22-00bf-4034-a669-bdbeb25b8ead admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:04.307654 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:04.324865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95b54bcd77cf4796942c094f6ef6a761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:04.345141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95b54bcd77cf4796942c094f6ef6a761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:04.398109 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1394/2794] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:54:04 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:54:04.402535 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9da22-00bf-4034-a669-bdbeb25b8ead admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:04.412782 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9da22-00bf-4034-a669-bdbeb25b8ead admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:04.419034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293083c-d73a-4d83-bc1b-645d97e501f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:04.419632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293083c-d73a-4d83-bc1b-645d97e501f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.419918 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293083c-d73a-4d83-bc1b-645d97e501f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.420192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293083c-d73a-4d83-bc1b-645d97e501f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.420947 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293083c-d73a-4d83-bc1b-645d97e501f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:04.422281 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95b54bcd77cf4796942c094f6ef6a761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:04.422560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293083c-d73a-4d83-bc1b-645d97e501f9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:04.423441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95b54bcd77cf4796942c094f6ef6a761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:04.431223 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c7797426-d846-41c4-9562-6a976cdc00d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95b54bcd77cf4796942c094f6ef6a761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:04.435904 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1395/2795] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:54:04.436908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293083c-d73a-4d83-bc1b-645d97e501f9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:04.438560 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6293083c-d73a-4d83-bc1b-645d97e501f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:04.441183 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1401/2796] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:04 2022] DELETE /identity/v3/users/95b54bcd77cf4796942c094f6ef6a761 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:04.445430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c1a13-422b-4894-b902-7a115a3e4be7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.458790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c1a13-422b-4894-b902-7a115a3e4be7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.458790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c1a13-422b-4894-b902-7a115a3e4be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.459050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293083c-d73a-4d83-bc1b-645d97e501f9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:04.465643 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-af1c1a13-422b-4894-b902-7a115a3e4be7 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:04.466860 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-af1c1a13-422b-4894-b902-7a115a3e4be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:04.518976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f82c4-849a-4aec-826e-f6890a7dc9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:04.519691 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f82c4-849a-4aec-826e-f6890a7dc9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.520004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f82c4-849a-4aec-826e-f6890a7dc9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.520282 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f82c4-849a-4aec-826e-f6890a7dc9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.521142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f82c4-849a-4aec-826e-f6890a7dc9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:04.524087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f82c4-849a-4aec-826e-f6890a7dc9ab admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:04.533743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1402/2797] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:54:04.538564 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1396/2798] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:04.541809 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c1a13-422b-4894-b902-7a115a3e4be7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:04.542397 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f82c4-849a-4aec-826e-f6890a7dc9ab admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:04.543266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-af1c1a13-422b-4894-b902-7a115a3e4be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:04.556241 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f82c4-849a-4aec-826e-f6890a7dc9ab admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:04.563530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b7b7-bd9b-4187-9d44-09fdec283548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:04.563844 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b7b7-bd9b-4187-9d44-09fdec283548 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.564378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b7b7-bd9b-4187-9d44-09fdec283548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.564378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b7b7-bd9b-4187-9d44-09fdec283548 admin admin] PATH_INFO: `/v3/projects/2d8661dc7ec548889295a36a4285ad1c/users/35bc5c523e574c4a8978bba32c2fc21c/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.580653 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:04.585620 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535b7b7-bd9b-4187-9d44-09fdec283548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8661dc7ec548889295a36a4285ad1c, user_id=35bc5c523e574c4a8978bba32c2fc21c, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:04.594289 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535b7b7-bd9b-4187-9d44-09fdec283548 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:04.623738 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c1a13-422b-4894-b902-7a115a3e4be7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:04.627339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5466a-aa4b-4260-b971-444abc8f73d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:04.627987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5466a-aa4b-4260-b971-444abc8f73d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.628277 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5466a-aa4b-4260-b971-444abc8f73d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.628558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5466a-aa4b-4260-b971-444abc8f73d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.638272 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5466a-aa4b-4260-b971-444abc8f73d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:04.639747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d5466a-aa4b-4260-b971-444abc8f73d3 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:04.658632 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1403/2799] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:04.692756 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1397/2800] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:54:04 2022] PUT /identity/v3/projects/2d8661dc7ec548889295a36a4285ad1c/users/35bc5c523e574c4a8978bba32c2fc21c/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:04.704972 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591b4b7-0294-4e5e-8920-992d5dacac58 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.705535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591b4b7-0294-4e5e-8920-992d5dacac58 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.705639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591b4b7-0294-4e5e-8920-992d5dacac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.735415 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7591b4b7-0294-4e5e-8920-992d5dacac58 None None] MFA Rules not processed for user `35bc5c523e574c4a8978bba32c2fc21c`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:04.736766 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7591b4b7-0294-4e5e-8920-992d5dacac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:04.779225 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:04.802911 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1404/2801] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:04.815063 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b7b7-bd9b-4187-9d44-09fdec283548 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:04.816863 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b535b7b7-bd9b-4187-9d44-09fdec283548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:04.877336 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b7b7-bd9b-4187-9d44-09fdec283548 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:04.882738 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0869af9-572d-4c9e-8d2d-c390bb753fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:04.884278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0869af9-572d-4c9e-8d2d-c390bb753fdf service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:04.884278 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0869af9-572d-4c9e-8d2d-c390bb753fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:04.885619 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0869af9-572d-4c9e-8d2d-c390bb753fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:04.904589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0869af9-572d-4c9e-8d2d-c390bb753fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:04.906443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0869af9-572d-4c9e-8d2d-c390bb753fdf service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:04.917344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1398/2802] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:05.152719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591b4b7-0294-4e5e-8920-992d5dacac58 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:05.154172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7591b4b7-0294-4e5e-8920-992d5dacac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:05.238998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7591b4b7-0294-4e5e-8920-992d5dacac58 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:05.244426 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:05.245374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:05.245722 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:05.246026 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] PATH_INFO: `/v3/projects/9aebcc66e9c74fb395ba3c33fb3ad863` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:05.247251 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aebcc66e9c74fb395ba3c33fb3ad863)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:05.249153 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:05.370956 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aebcc66e9c74fb395ba3c33fb3ad863', 'request_id': 'req-a51c6ddb-c4be-4827-b4fe-1f378c523379'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.450588 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aebcc66e9c74fb395ba3c33fb3ad863', 'request_id': 'req-a51c6ddb-c4be-4827-b4fe-1f378c523379'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.458278 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aebcc66e9c74fb395ba3c33fb3ad863', 'request_id': 'req-a51c6ddb-c4be-4827-b4fe-1f378c523379'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.470789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] The token cache is being invalidate because project 9aebcc66e9c74fb395ba3c33fb3ad863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:05.471237 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.471971 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.473873 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1405/2803] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:05 2022] DELETE /identity/v3/projects/9aebcc66e9c74fb395ba3c33fb3ad863 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:05.477579 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0869af9-572d-4c9e-8d2d-c390bb753fdf service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:05.489584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0869af9-572d-4c9e-8d2d-c390bb753fdf service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:05.549781 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:05.550659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:05.551944 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:05.553091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] PATH_INFO: `/v3/users/1aaeec38b74647d78b72fc4c3622c173` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:05.554327 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aaeec38b74647d78b72fc4c3622c173)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:05.556349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:05.828360 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aaeec38b74647d78b72fc4c3622c173'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.829250 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aaeec38b74647d78b72fc4c3622c173'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.857208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aaeec38b74647d78b72fc4c3622c173'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.866632 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aaeec38b74647d78b72fc4c3622c173'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.940217 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dc1c3063-fc89-43cd-be7e-3860b412e7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aaeec38b74647d78b72fc4c3622c173'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:05.947901 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1399/2804] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:05 2022] DELETE /identity/v3/users/1aaeec38b74647d78b72fc4c3622c173 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:06.483599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:06.485662 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:06.509929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c6ddb-c4be-4827-b4fe-1f378c523379 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:06.597318 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:06.598976 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:06.599264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:06.599846 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] PATH_INFO: `/v3/projects/f9ed5d3b5ea74d60a6965be3f9db3878` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:06.601127 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ed5d3b5ea74d60a6965be3f9db3878)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:06.604474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:06.620836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:06.760444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ed5d3b5ea74d60a6965be3f9db3878', 'request_id': 'req-b8917db3-7934-48bc-9478-46d26c105475'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:06.872890 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ed5d3b5ea74d60a6965be3f9db3878', 'request_id': 'req-b8917db3-7934-48bc-9478-46d26c105475'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:06.878610 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ed5d3b5ea74d60a6965be3f9db3878', 'request_id': 'req-b8917db3-7934-48bc-9478-46d26c105475'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:06.890161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] The token cache is being invalidate because project f9ed5d3b5ea74d60a6965be3f9db3878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:06.890454 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:06.891408 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b8917db3-7934-48bc-9478-46d26c105475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:06.892980 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1406/2805] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:06 2022] DELETE /identity/v3/projects/f9ed5d3b5ea74d60a6965be3f9db3878 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:06.897925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd032-1a2b-44e1-bbc5-cf1c47dbca1d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:06.898412 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd032-1a2b-44e1-bbc5-cf1c47dbca1d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:06.898512 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccd032-1a2b-44e1-bbc5-cf1c47dbca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:06.916547 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-30ccd032-1a2b-44e1-bbc5-cf1c47dbca1d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:06.917908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-30ccd032-1a2b-44e1-bbc5-cf1c47dbca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:06.927929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:06.977993 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1400/2806] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:54:06.985786 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7bf70-4976-4cb8-931d-d7e7e411e1af None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:06.986077 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7bf70-4976-4cb8-931d-d7e7e411e1af None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:06.986359 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7bf70-4976-4cb8-931d-d7e7e411e1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.004855 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b4f7bf70-4976-4cb8-931d-d7e7e411e1af None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:07.008611 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b4f7bf70-4976-4cb8-931d-d7e7e411e1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:07.015005 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1407/2807] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:07.019410 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd032-1a2b-44e1-bbc5-cf1c47dbca1d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:07.029689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccd032-1a2b-44e1-bbc5-cf1c47dbca1d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:07.034296 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c0b91-738d-4953-b094-fcc293a34988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:07.034977 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0b91-738d-4953-b094-fcc293a34988 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:07.035266 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0b91-738d-4953-b094-fcc293a34988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:07.037306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0b91-738d-4953-b094-fcc293a34988 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.037306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c0b91-738d-4953-b094-fcc293a34988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:54:07.037306 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c0b91-738d-4953-b094-fcc293a34988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:07.038208 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c0b91-738d-4953-b094-fcc293a34988 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:07.050417 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1401/2808] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:54:07.054729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7bf70-4976-4cb8-931d-d7e7e411e1af None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:07.064239 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7bf70-4976-4cb8-931d-d7e7e411e1af None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:07.068944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baffdf-4614-4b64-8bc8-f148cf8a2da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:07.069592 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baffdf-4614-4b64-8bc8-f148cf8a2da8 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:07.069876 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baffdf-4614-4b64-8bc8-f148cf8a2da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:07.070150 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baffdf-4614-4b64-8bc8-f148cf8a2da8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.070936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baffdf-4614-4b64-8bc8-f148cf8a2da8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:07.073790 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baffdf-4614-4b64-8bc8-f148cf8a2da8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:07.192764 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1408/2809] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:54:07 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:07.193829 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c0b91-738d-4953-b094-fcc293a34988 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:07.204490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c0b91-738d-4953-b094-fcc293a34988 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:07.261544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f343e-8647-4a33-b6a9-c3448c9ecaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:07.262395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f343e-8647-4a33-b6a9-c3448c9ecaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:07.262682 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f343e-8647-4a33-b6a9-c3448c9ecaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:07.263000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f343e-8647-4a33-b6a9-c3448c9ecaa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.263689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f343e-8647-4a33-b6a9-c3448c9ecaa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:07.265643 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f343e-8647-4a33-b6a9-c3448c9ecaa8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:07.380749 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1402/2810] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:54:07 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:54:07.381310 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baffdf-4614-4b64-8bc8-f148cf8a2da8 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:07.393029 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baffdf-4614-4b64-8bc8-f148cf8a2da8 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:07.397744 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b90e1d-a3d4-44db-be88-7038d05fd3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:07.398430 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b90e1d-a3d4-44db-be88-7038d05fd3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:07.398717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b90e1d-a3d4-44db-be88-7038d05fd3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:07.399031 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b90e1d-a3d4-44db-be88-7038d05fd3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.400172 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b90e1d-a3d4-44db-be88-7038d05fd3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:07.401794 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b90e1d-a3d4-44db-be88-7038d05fd3e7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:07.412668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1409/2811] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:07.417724 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f343e-8647-4a33-b6a9-c3448c9ecaa8 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:07.427721 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f343e-8647-4a33-b6a9-c3448c9ecaa8 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:07.433105 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647d831-7c3a-41f1-90c0-3368786d365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:07.433761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647d831-7c3a-41f1-90c0-3368786d365d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:07.434041 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647d831-7c3a-41f1-90c0-3368786d365d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:07.435078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647d831-7c3a-41f1-90c0-3368786d365d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.435820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647d831-7c3a-41f1-90c0-3368786d365d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:07.437636 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647d831-7c3a-41f1-90c0-3368786d365d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:07.448530 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1403/2812] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:07.452795 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b90e1d-a3d4-44db-be88-7038d05fd3e7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:07.463917 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b90e1d-a3d4-44db-be88-7038d05fd3e7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:07.468906 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46925441-8c5d-4e5b-b5e0-14d9ec3eae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:07.472394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46925441-8c5d-4e5b-b5e0-14d9ec3eae13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:07.472394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46925441-8c5d-4e5b-b5e0-14d9ec3eae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:07.472394 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46925441-8c5d-4e5b-b5e0-14d9ec3eae13 admin admin] PATH_INFO: `/v3/projects/fb2553ba2a044495b79ff8e800b271a1/users/f6b5031362a240a58c16db14d790da3a/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.484739 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46925441-8c5d-4e5b-b5e0-14d9ec3eae13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2553ba2a044495b79ff8e800b271a1, user_id=f6b5031362a240a58c16db14d790da3a, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:07.487420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46925441-8c5d-4e5b-b5e0-14d9ec3eae13 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:07.575704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1410/2813] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:54:07 2022] PUT /identity/v3/projects/fb2553ba2a044495b79ff8e800b271a1/users/f6b5031362a240a58c16db14d790da3a/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:07.586813 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae346ff-fd4a-47b9-95a8-8f2289b8f2f4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:07.587149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae346ff-fd4a-47b9-95a8-8f2289b8f2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:07.587891 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae346ff-fd4a-47b9-95a8-8f2289b8f2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.616913 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0ae346ff-fd4a-47b9-95a8-8f2289b8f2f4 None None] MFA Rules not processed for user `f6b5031362a240a58c16db14d790da3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:07.618138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0ae346ff-fd4a-47b9-95a8-8f2289b8f2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:07.683288 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1404/2814] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:07.687783 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46925441-8c5d-4e5b-b5e0-14d9ec3eae13 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:07.751174 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46925441-8c5d-4e5b-b5e0-14d9ec3eae13 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:07.755959 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e22063-af4d-44af-97b6-5b0c934577d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:07.756622 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e22063-af4d-44af-97b6-5b0c934577d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:07.756921 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e22063-af4d-44af-97b6-5b0c934577d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:07.757195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e22063-af4d-44af-97b6-5b0c934577d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.757885 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e22063-af4d-44af-97b6-5b0c934577d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:07.759883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e22063-af4d-44af-97b6-5b0c934577d0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:07.867534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1411/2815] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:54:07 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:07.872124 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae346ff-fd4a-47b9-95a8-8f2289b8f2f4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:07.882923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae346ff-fd4a-47b9-95a8-8f2289b8f2f4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:07.888291 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:07.938957 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ab18-db08-44ec-b8ba-97d2d44fe6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:07.939610 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ab18-db08-44ec-b8ba-97d2d44fe6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:07.939899 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ab18-db08-44ec-b8ba-97d2d44fe6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:07.940238 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ab18-db08-44ec-b8ba-97d2d44fe6f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:07.940935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72ab18-db08-44ec-b8ba-97d2d44fe6f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:07.942945 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72ab18-db08-44ec-b8ba-97d2d44fe6f2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:08.049858 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1405/2816] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:54:07 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:08.053867 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e22063-af4d-44af-97b6-5b0c934577d0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:08.064645 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e22063-af4d-44af-97b6-5b0c934577d0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:08.069284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dbbed-e6a6-4d73-af3e-35ff2d2dd077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:08.069944 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dbbed-e6a6-4d73-af3e-35ff2d2dd077 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:08.070232 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dbbed-e6a6-4d73-af3e-35ff2d2dd077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:08.070513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1dbbed-e6a6-4d73-af3e-35ff2d2dd077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:08.071271 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dbbed-e6a6-4d73-af3e-35ff2d2dd077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:08.073033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1dbbed-e6a6-4d73-af3e-35ff2d2dd077 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:08.083534 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1412/2817] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:08.088007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ab18-db08-44ec-b8ba-97d2d44fe6f2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:08.098004 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ab18-db08-44ec-b8ba-97d2d44fe6f2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:08.102709 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda0a36-4f10-499a-8540-f4ec6fc5f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:08.104704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda0a36-4f10-499a-8540-f4ec6fc5f752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:08.104990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda0a36-4f10-499a-8540-f4ec6fc5f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:08.105268 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda0a36-4f10-499a-8540-f4ec6fc5f752 admin admin] PATH_INFO: `/v3/projects/3fb5af12d20d44e0aaaebec74879849b/users/3b139da2eb5c4b9983757783c6b16b88/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:08.119999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda0a36-4f10-499a-8540-f4ec6fc5f752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb5af12d20d44e0aaaebec74879849b, user_id=3b139da2eb5c4b9983757783c6b16b88, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:08.122652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcda0a36-4f10-499a-8540-f4ec6fc5f752 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:08.239350 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1406/2818] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:54:08 2022] PUT /identity/v3/projects/3fb5af12d20d44e0aaaebec74879849b/users/3b139da2eb5c4b9983757783c6b16b88/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:08.243260 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dbbed-e6a6-4d73-af3e-35ff2d2dd077 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:08.254929 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1dbbed-e6a6-4d73-af3e-35ff2d2dd077 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:08.264244 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:08.317787 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a49fd-876f-4a61-8ff0-94bc9ca2164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:08.318455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a49fd-876f-4a61-8ff0-94bc9ca2164f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:08.318737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a49fd-876f-4a61-8ff0-94bc9ca2164f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:08.319042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a49fd-876f-4a61-8ff0-94bc9ca2164f admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:08.319761 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a49fd-876f-4a61-8ff0-94bc9ca2164f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:08.321367 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a49fd-876f-4a61-8ff0-94bc9ca2164f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:08.331546 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1413/2819] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:08.335720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda0a36-4f10-499a-8540-f4ec6fc5f752 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:08.346667 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda0a36-4f10-499a-8540-f4ec6fc5f752 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:08.351328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275852ef-1dd7-4206-ab45-0a702a13f2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:08.352206 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275852ef-1dd7-4206-ab45-0a702a13f2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:08.352487 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275852ef-1dd7-4206-ab45-0a702a13f2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:08.352762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275852ef-1dd7-4206-ab45-0a702a13f2c0 admin admin] PATH_INFO: `/v3/projects/3fb5af12d20d44e0aaaebec74879849b/users/3b139da2eb5c4b9983757783c6b16b88/roles/9312183c32b04118985c8316f33f3830` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:08.355661 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275852ef-1dd7-4206-ab45-0a702a13f2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb5af12d20d44e0aaaebec74879849b, user_id=3b139da2eb5c4b9983757783c6b16b88, role_id=9312183c32b04118985c8316f33f3830)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:08.358378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275852ef-1dd7-4206-ab45-0a702a13f2c0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:08.368614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1407/2820] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:54:08 2022] PUT /identity/v3/projects/3fb5af12d20d44e0aaaebec74879849b/users/3b139da2eb5c4b9983757783c6b16b88/roles/9312183c32b04118985c8316f33f3830 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:08.378966 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd200f1-78b4-4da1-9428-1d386651e3c2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:08.379195 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd200f1-78b4-4da1-9428-1d386651e3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:08.379475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd200f1-78b4-4da1-9428-1d386651e3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:08.410601 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1bd200f1-78b4-4da1-9428-1d386651e3c2 None None] MFA Rules not processed for user `3b139da2eb5c4b9983757783c6b16b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:08.411880 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1bd200f1-78b4-4da1-9428-1d386651e3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:08.489088 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1414/2821] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:08.502045 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275852ef-1dd7-4206-ab45-0a702a13f2c0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:08.505939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-275852ef-1dd7-4206-ab45-0a702a13f2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:08.568270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275852ef-1dd7-4206-ab45-0a702a13f2c0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:08.572916 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aca41a-718e-4583-82a6-465c8c04045c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:08.573589 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aca41a-718e-4583-82a6-465c8c04045c service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:08.573877 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aca41a-718e-4583-82a6-465c8c04045c service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:08.574156 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aca41a-718e-4583-82a6-465c8c04045c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:08.583659 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aca41a-718e-4583-82a6-465c8c04045c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:08.585131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aca41a-718e-4583-82a6-465c8c04045c service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:08.596071 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1408/2822] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:54:08.720473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd200f1-78b4-4da1-9428-1d386651e3c2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:08.721942 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1bd200f1-78b4-4da1-9428-1d386651e3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:08.734362 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd200f1-78b4-4da1-9428-1d386651e3c2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:08.738590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1c232-c8fc-49d5-8d50-6f883d2515b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:08.739323 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1c232-c8fc-49d5-8d50-6f883d2515b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:08.739616 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1c232-c8fc-49d5-8d50-6f883d2515b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:08.739899 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1c232-c8fc-49d5-8d50-6f883d2515b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:08.804998 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1c232-c8fc-49d5-8d50-6f883d2515b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:08.807440 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead1c232-c8fc-49d5-8d50-6f883d2515b2 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:08.816414 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1415/2823] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:10.963754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aca41a-718e-4583-82a6-465c8c04045c service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:10.964919 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e1aca41a-718e-4583-82a6-465c8c04045c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:11.030735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aca41a-718e-4583-82a6-465c8c04045c service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:11.035510 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:11.036381 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:11.036674 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:11.036953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] PATH_INFO: `/v3/users/35bc5c523e574c4a8978bba32c2fc21c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:11.038138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bc5c523e574c4a8978bba32c2fc21c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:11.040112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:11.045431 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:11.224684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bc5c523e574c4a8978bba32c2fc21c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:11.225349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bc5c523e574c4a8978bba32c2fc21c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:11.237951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bc5c523e574c4a8978bba32c2fc21c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:11.245380 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bc5c523e574c4a8978bba32c2fc21c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:11.323307 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bc5c523e574c4a8978bba32c2fc21c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:11.329521 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1409/2824] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:10 2022] DELETE /identity/v3/users/35bc5c523e574c4a8978bba32c2fc21c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:11.334098 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d876997-a998-46e1-87fa-b914a47c8022 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:11.334571 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d876997-a998-46e1-87fa-b914a47c8022 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:11.334816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d876997-a998-46e1-87fa-b914a47c8022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:11.352364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8d876997-a998-46e1-87fa-b914a47c8022 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:11.353984 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8d876997-a998-46e1-87fa-b914a47c8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:11.380034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:11.413038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1416/2825] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:54:11.423725 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:11.425142 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:11.492454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff7044-c561-4ec8-8637-c43259ffe134 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:11.496520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49efe1-b44c-4fbf-b29a-5a5d17c370da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:11.497159 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49efe1-b44c-4fbf-b29a-5a5d17c370da service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:11.497439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49efe1-b44c-4fbf-b29a-5a5d17c370da service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:11.497712 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49efe1-b44c-4fbf-b29a-5a5d17c370da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:11.506707 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49efe1-b44c-4fbf-b29a-5a5d17c370da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:11.508171 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49efe1-b44c-4fbf-b29a-5a5d17c370da service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:11.518741 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1410/2826] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:11.983483 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d876997-a998-46e1-87fa-b914a47c8022 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:11.985056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8d876997-a998-46e1-87fa-b914a47c8022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:11.999231 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d876997-a998-46e1-87fa-b914a47c8022 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:12.003762 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:12.005241 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:12.005603 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:12.005962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] PATH_INFO: `/v3/projects/2d8661dc7ec548889295a36a4285ad1c` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:12.007270 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8661dc7ec548889295a36a4285ad1c)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:12.009283 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:12.113330 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8661dc7ec548889295a36a4285ad1c', 'request_id': 'req-62438ae4-c2da-4316-8e3d-a58d128da152'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:12.192805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8661dc7ec548889295a36a4285ad1c', 'request_id': 'req-62438ae4-c2da-4316-8e3d-a58d128da152'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:12.198934 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8661dc7ec548889295a36a4285ad1c', 'request_id': 'req-62438ae4-c2da-4316-8e3d-a58d128da152'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:12.210033 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] The token cache is being invalidate because project 2d8661dc7ec548889295a36a4285ad1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:12.210324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:12.210990 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-62438ae4-c2da-4316-8e3d-a58d128da152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:12.212547 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1417/2827] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:11 2022] DELETE /identity/v3/projects/2d8661dc7ec548889295a36a4285ad1c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:54:13.529169 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49efe1-b44c-4fbf-b29a-5a5d17c370da service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:13.530731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5a49efe1-b44c-4fbf-b29a-5a5d17c370da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:13.545187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49efe1-b44c-4fbf-b29a-5a5d17c370da service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:13.605677 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:13.606482 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:13.606773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:13.607087 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] PATH_INFO: `/v3/users/f6b5031362a240a58c16db14d790da3a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:13.608302 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b5031362a240a58c16db14d790da3a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:13.610223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:13.713773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:13.822231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b5031362a240a58c16db14d790da3a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:13.822705 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b5031362a240a58c16db14d790da3a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:13.835126 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b5031362a240a58c16db14d790da3a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:13.841998 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b5031362a240a58c16db14d790da3a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:13.905454 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b5031362a240a58c16db14d790da3a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:13.912352 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1411/2828] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:13 2022] DELETE /identity/v3/users/f6b5031362a240a58c16db14d790da3a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:13.917864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3f1c6-d99e-4a5e-9066-b12168d45dd0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:13.918375 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3f1c6-d99e-4a5e-9066-b12168d45dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:13.918488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3f1c6-d99e-4a5e-9066-b12168d45dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:13.941499 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-baa3f1c6-d99e-4a5e-9066-b12168d45dd0 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:13.942661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-baa3f1c6-d99e-4a5e-9066-b12168d45dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:14.005473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1418/2829] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:14.015166 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:14.017002 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:14.078420 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080bfb99-60a4-4ccc-817e-090e51485000 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:14.082059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9176a-94b8-49e7-b6b7-7d3d0503c177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:14.082698 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9176a-94b8-49e7-b6b7-7d3d0503c177 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:14.083016 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9176a-94b8-49e7-b6b7-7d3d0503c177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:14.083297 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9176a-94b8-49e7-b6b7-7d3d0503c177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:14.093406 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9176a-94b8-49e7-b6b7-7d3d0503c177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:14.094872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9176a-94b8-49e7-b6b7-7d3d0503c177 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:14.105801 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1412/2830] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:14.625365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3f1c6-d99e-4a5e-9066-b12168d45dd0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:14.626768 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-baa3f1c6-d99e-4a5e-9066-b12168d45dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:14.651675 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3f1c6-d99e-4a5e-9066-b12168d45dd0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:14.651675 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:14.658816 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:14.659366 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:14.660177 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] PATH_INFO: `/v3/projects/fb2553ba2a044495b79ff8e800b271a1` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:14.662143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2553ba2a044495b79ff8e800b271a1)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:14.664164 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:14.840864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2553ba2a044495b79ff8e800b271a1', 'request_id': 'req-02bc7c70-f0b0-4678-b0a7-936094cd9965'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:14.843027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:14.912007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2553ba2a044495b79ff8e800b271a1', 'request_id': 'req-02bc7c70-f0b0-4678-b0a7-936094cd9965'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:14.921052 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2553ba2a044495b79ff8e800b271a1', 'request_id': 'req-02bc7c70-f0b0-4678-b0a7-936094cd9965'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:14.932285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] The token cache is being invalidate because project fb2553ba2a044495b79ff8e800b271a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:14.932577 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:14.933476 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:14.935488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1419/2831] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:14 2022] DELETE /identity/v3/projects/fb2553ba2a044495b79ff8e800b271a1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:14.939223 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9176a-94b8-49e7-b6b7-7d3d0503c177 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:14.949520 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9176a-94b8-49e7-b6b7-7d3d0503c177 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:15.041094 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:15.042221 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:15.042605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:15.043051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] PATH_INFO: `/v3/users/3b139da2eb5c4b9983757783c6b16b88` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:15.044544 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b139da2eb5c4b9983757783c6b16b88)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:15.046546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:15.247091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b139da2eb5c4b9983757783c6b16b88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:15.247963 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b139da2eb5c4b9983757783c6b16b88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:15.249895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:15.261770 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b139da2eb5c4b9983757783c6b16b88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:15.269267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b139da2eb5c4b9983757783c6b16b88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:15.345990 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-18ea816e-ce28-4d6c-8756-5f8ae313cc66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b139da2eb5c4b9983757783c6b16b88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:15.353729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1413/2832] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:14 2022] DELETE /identity/v3/users/3b139da2eb5c4b9983757783c6b16b88 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:15.760243 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:15.761827 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:15.775884 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc7c70-f0b0-4678-b0a7-936094cd9965 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:15.834165 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:15.835068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:15.835360 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:15.835640 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] PATH_INFO: `/v3/projects/3fb5af12d20d44e0aaaebec74879849b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:15.836818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb5af12d20d44e0aaaebec74879849b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:15.839115 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:15.947288 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb5af12d20d44e0aaaebec74879849b', 'request_id': 'req-276bc24f-ad66-41cf-b40b-e3a686b81e1e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:16.019765 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb5af12d20d44e0aaaebec74879849b', 'request_id': 'req-276bc24f-ad66-41cf-b40b-e3a686b81e1e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:16.025489 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb5af12d20d44e0aaaebec74879849b', 'request_id': 'req-276bc24f-ad66-41cf-b40b-e3a686b81e1e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:16.036506 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] The token cache is being invalidate because project 3fb5af12d20d44e0aaaebec74879849b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:16.036795 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:16.037422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-276bc24f-ad66-41cf-b40b-e3a686b81e1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:16.039020 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1420/2833] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:15 2022] DELETE /identity/v3/projects/3fb5af12d20d44e0aaaebec74879849b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:16.044584 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2205e5-7be7-452f-9839-b51e1197ecb4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.045077 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2205e5-7be7-452f-9839-b51e1197ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.045184 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2205e5-7be7-452f-9839-b51e1197ecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.063637 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3e2205e5-7be7-452f-9839-b51e1197ecb4 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:16.064841 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3e2205e5-7be7-452f-9839-b51e1197ecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:16.123475 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1414/2834] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:16.131348 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c23265-e37d-4744-bcd4-62a1cda00a26 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.131641 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c23265-e37d-4744-bcd4-62a1cda00a26 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.131924 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c23265-e37d-4744-bcd4-62a1cda00a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.151247 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e3c23265-e37d-4744-bcd4-62a1cda00a26 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:16.152484 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e3c23265-e37d-4744-bcd4-62a1cda00a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:16.160551 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1421/2835] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:16.164574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2205e5-7be7-452f-9839-b51e1197ecb4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:16.175481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2205e5-7be7-452f-9839-b51e1197ecb4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:16.180043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f3290-ddb2-43c3-9904-70a19d3c92e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:16.180715 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f3290-ddb2-43c3-9904-70a19d3c92e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.181003 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f3290-ddb2-43c3-9904-70a19d3c92e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.181349 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f3290-ddb2-43c3-9904-70a19d3c92e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.182763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f3290-ddb2-43c3-9904-70a19d3c92e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:54:16.183101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f3290-ddb2-43c3-9904-70a19d3c92e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:16.184720 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f3290-ddb2-43c3-9904-70a19d3c92e9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:16.196702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1415/2836] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:54:16.202832 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c23265-e37d-4744-bcd4-62a1cda00a26 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:16.212136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c23265-e37d-4744-bcd4-62a1cda00a26 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:16.217516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c13fd-dc48-4b73-967b-05d702b83a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:16.218176 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c13fd-dc48-4b73-967b-05d702b83a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.218463 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c13fd-dc48-4b73-967b-05d702b83a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.218743 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c13fd-dc48-4b73-967b-05d702b83a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.219475 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c13fd-dc48-4b73-967b-05d702b83a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:16.221374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c13fd-dc48-4b73-967b-05d702b83a3d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:16.309731 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1422/2837] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:54:16 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:16.311481 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f3290-ddb2-43c3-9904-70a19d3c92e9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:16.324731 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f3290-ddb2-43c3-9904-70a19d3c92e9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:16.387153 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552778-b8a8-4653-8fe4-f064fe745344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:16.387822 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552778-b8a8-4653-8fe4-f064fe745344 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.388103 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552778-b8a8-4653-8fe4-f064fe745344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.388378 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab552778-b8a8-4653-8fe4-f064fe745344 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.389062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab552778-b8a8-4653-8fe4-f064fe745344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:16.391886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab552778-b8a8-4653-8fe4-f064fe745344 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:16.501562 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1416/2838] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:54:16 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:16.505703 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c13fd-dc48-4b73-967b-05d702b83a3d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:16.517007 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c13fd-dc48-4b73-967b-05d702b83a3d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:16.521570 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648c3ed-f478-45dd-b76b-ec2947aca693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:16.527120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648c3ed-f478-45dd-b76b-ec2947aca693 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.527120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648c3ed-f478-45dd-b76b-ec2947aca693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.527120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648c3ed-f478-45dd-b76b-ec2947aca693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.527120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648c3ed-f478-45dd-b76b-ec2947aca693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:16.527120 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648c3ed-f478-45dd-b76b-ec2947aca693 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:16.536298 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1423/2839] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:54:16.540175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552778-b8a8-4653-8fe4-f064fe745344 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:16.550370 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab552778-b8a8-4653-8fe4-f064fe745344 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:16.555034 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb434b15-b6e0-43fb-90be-7881e0a44180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:16.558281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb434b15-b6e0-43fb-90be-7881e0a44180 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.558281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb434b15-b6e0-43fb-90be-7881e0a44180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.558281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb434b15-b6e0-43fb-90be-7881e0a44180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.558281 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb434b15-b6e0-43fb-90be-7881e0a44180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:16.558796 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb434b15-b6e0-43fb-90be-7881e0a44180 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:16.568743 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1417/2840] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:16.573568 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648c3ed-f478-45dd-b76b-ec2947aca693 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:16.583531 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648c3ed-f478-45dd-b76b-ec2947aca693 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:16.588630 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef8eb-cd27-45a8-86d7-2107cab99794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:16.589513 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef8eb-cd27-45a8-86d7-2107cab99794 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.589802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef8eb-cd27-45a8-86d7-2107cab99794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.590082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ef8eb-cd27-45a8-86d7-2107cab99794 admin admin] PATH_INFO: `/v3/projects/be322e64d86c4c7988251d9661e9c380/users/2c1485342ab345caa63525dab36af082/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.604886 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ef8eb-cd27-45a8-86d7-2107cab99794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be322e64d86c4c7988251d9661e9c380, user_id=2c1485342ab345caa63525dab36af082, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:16.607584 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ef8eb-cd27-45a8-86d7-2107cab99794 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:16.681037 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1424/2841] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:54:16 2022] PUT /identity/v3/projects/be322e64d86c4c7988251d9661e9c380/users/2c1485342ab345caa63525dab36af082/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:16.691857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b43169-6a12-459d-9a22-72c0028e6cf5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.710654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b43169-6a12-459d-9a22-72c0028e6cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.710654 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b43169-6a12-459d-9a22-72c0028e6cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.720895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a4b43169-6a12-459d-9a22-72c0028e6cf5 None None] MFA Rules not processed for user `2c1485342ab345caa63525dab36af082`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:16.722119 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a4b43169-6a12-459d-9a22-72c0028e6cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:16.742976 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:16.787752 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1418/2842] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:16.799295 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef8eb-cd27-45a8-86d7-2107cab99794 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:16.801382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ba3ef8eb-cd27-45a8-86d7-2107cab99794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:16.808275 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:16.861034 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ef8eb-cd27-45a8-86d7-2107cab99794 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:16.864801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b143e6-bcbe-4226-b3c9-8f8bad8bda1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:16.865446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b143e6-bcbe-4226-b3c9-8f8bad8bda1e service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.865729 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b143e6-bcbe-4226-b3c9-8f8bad8bda1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.866009 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b143e6-bcbe-4226-b3c9-8f8bad8bda1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.875410 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b143e6-bcbe-4226-b3c9-8f8bad8bda1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:16.876961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b143e6-bcbe-4226-b3c9-8f8bad8bda1e service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:16.887332 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1425/2843] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:16.907050 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b43169-6a12-459d-9a22-72c0028e6cf5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:16.969857 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b43169-6a12-459d-9a22-72c0028e6cf5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:16.975633 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:16.976509 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:16.976789 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:16.977064 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] PATH_INFO: `/v3/users/2c1485342ab345caa63525dab36af082` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:16.978480 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1485342ab345caa63525dab36af082)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:16.980626 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:17.240070 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1485342ab345caa63525dab36af082'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:17.240805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1485342ab345caa63525dab36af082'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:17.253580 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1485342ab345caa63525dab36af082'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:17.260917 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1485342ab345caa63525dab36af082'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:17.351618 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1485342ab345caa63525dab36af082'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:17.359625 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1419/2844] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:16 2022] DELETE /identity/v3/users/2c1485342ab345caa63525dab36af082 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:17.364161 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac2745-c7b1-4af6-978e-d543ecfe0951 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:17.364651 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac2745-c7b1-4af6-978e-d543ecfe0951 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:17.364760 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac2745-c7b1-4af6-978e-d543ecfe0951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:17.384995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bdac2745-c7b1-4af6-978e-d543ecfe0951 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:17.386336 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bdac2745-c7b1-4af6-978e-d543ecfe0951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:17.457378 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1426/2845] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:17.467803 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:17.469304 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:17.522008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:17.534936 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654426e-76ea-48fc-b40d-0ea202c78326 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:17.538754 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607799b-5e3a-4b4a-89aa-89dc13d6b96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:17.539488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607799b-5e3a-4b4a-89aa-89dc13d6b96a service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:17.539776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607799b-5e3a-4b4a-89aa-89dc13d6b96a service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:17.540055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607799b-5e3a-4b4a-89aa-89dc13d6b96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:17.551013 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607799b-5e3a-4b4a-89aa-89dc13d6b96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:17.552476 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b607799b-5e3a-4b4a-89aa-89dc13d6b96a service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:17.563415 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1420/2846] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:17.975661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac2745-c7b1-4af6-978e-d543ecfe0951 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:17.977119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bdac2745-c7b1-4af6-978e-d543ecfe0951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:17.990324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac2745-c7b1-4af6-978e-d543ecfe0951 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:17.995833 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:17.996789 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:17.997167 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:17.997510 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] PATH_INFO: `/v3/projects/be322e64d86c4c7988251d9661e9c380` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:17.998785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be322e64d86c4c7988251d9661e9c380)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:18.000837 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:18.095778 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607799b-5e3a-4b4a-89aa-89dc13d6b96a service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:18.097158 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b607799b-5e3a-4b4a-89aa-89dc13d6b96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:18.131074 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be322e64d86c4c7988251d9661e9c380', 'request_id': 'req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:18.174272 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607799b-5e3a-4b4a-89aa-89dc13d6b96a service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:18.192948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be322e64d86c4c7988251d9661e9c380', 'request_id': 'req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:18.200593 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be322e64d86c4c7988251d9661e9c380', 'request_id': 'req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:18.213266 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] The token cache is being invalidate because project be322e64d86c4c7988251d9661e9c380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:18.213559 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:18.214364 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dd2013d4-11aa-4974-a2e2-c2a58ff8bf0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:18.216092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1427/2847] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:17 2022] DELETE /identity/v3/projects/be322e64d86c4c7988251d9661e9c380 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:18.220639 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850093-34bc-4121-bbd3-df2350bd1b4e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.226117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850093-34bc-4121-bbd3-df2350bd1b4e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.226117 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3850093-34bc-4121-bbd3-df2350bd1b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.238147 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d517959-e54d-4d85-93c1-3d655fac8c36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:18.238874 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d517959-e54d-4d85-93c1-3d655fac8c36 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.239014 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b3850093-34bc-4121-bbd3-df2350bd1b4e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:18.239149 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d517959-e54d-4d85-93c1-3d655fac8c36 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.239430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d517959-e54d-4d85-93c1-3d655fac8c36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.240118 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b3850093-34bc-4121-bbd3-df2350bd1b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:18.241213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5d517959-e54d-4d85-93c1-3d655fac8c36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:18.253092 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d517959-e54d-4d85-93c1-3d655fac8c36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:18.254937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d517959-e54d-4d85-93c1-3d655fac8c36 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:18.265920 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1421/2848] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:18.267070 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:18.302517 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1428/2849] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:54:18.310953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84953d5f-90eb-4e55-995e-8d7025ec7e20 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.311292 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84953d5f-90eb-4e55-995e-8d7025ec7e20 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.311687 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84953d5f-90eb-4e55-995e-8d7025ec7e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.330689 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-84953d5f-90eb-4e55-995e-8d7025ec7e20 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:18.331951 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-84953d5f-90eb-4e55-995e-8d7025ec7e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:18.340655 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1422/2850] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:18.345076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3850093-34bc-4121-bbd3-df2350bd1b4e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:18.355887 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3850093-34bc-4121-bbd3-df2350bd1b4e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:18.360719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752bf16-cbe7-4fdf-8df7-9374aeef6171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:18.361407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752bf16-cbe7-4fdf-8df7-9374aeef6171 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.361690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752bf16-cbe7-4fdf-8df7-9374aeef6171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.361962 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752bf16-cbe7-4fdf-8df7-9374aeef6171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.362683 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752bf16-cbe7-4fdf-8df7-9374aeef6171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:54:18.363054 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752bf16-cbe7-4fdf-8df7-9374aeef6171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:18.365136 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752bf16-cbe7-4fdf-8df7-9374aeef6171 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:18.379300 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1429/2851] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:54:18.383755 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84953d5f-90eb-4e55-995e-8d7025ec7e20 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:18.393878 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84953d5f-90eb-4e55-995e-8d7025ec7e20 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:18.398684 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38050-7333-4895-9f3c-8a4b76caa5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:18.399449 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38050-7333-4895-9f3c-8a4b76caa5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.399737 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38050-7333-4895-9f3c-8a4b76caa5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.400855 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38050-7333-4895-9f3c-8a4b76caa5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.401573 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf38050-7333-4895-9f3c-8a4b76caa5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:18.403703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf38050-7333-4895-9f3c-8a4b76caa5f3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:18.561101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1423/2852] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:54:18 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:18.573226 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752bf16-cbe7-4fdf-8df7-9374aeef6171 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:18.583473 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752bf16-cbe7-4fdf-8df7-9374aeef6171 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:18.640143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea54bf-6605-4f76-b4d0-8e0409b8e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:18.640812 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea54bf-6605-4f76-b4d0-8e0409b8e332 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.641104 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea54bf-6605-4f76-b4d0-8e0409b8e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.641669 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea54bf-6605-4f76-b4d0-8e0409b8e332 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.642469 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea54bf-6605-4f76-b4d0-8e0409b8e332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:18.644468 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea54bf-6605-4f76-b4d0-8e0409b8e332 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:18.713706 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1430/2853] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:54:18 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:18.717819 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38050-7333-4895-9f3c-8a4b76caa5f3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:18.728008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38050-7333-4895-9f3c-8a4b76caa5f3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:18.733303 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecca6f-f0d6-4c1d-98f9-05a408c10a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:18.733968 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecca6f-f0d6-4c1d-98f9-05a408c10a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.745046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecca6f-f0d6-4c1d-98f9-05a408c10a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.745046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecca6f-f0d6-4c1d-98f9-05a408c10a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.745046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecca6f-f0d6-4c1d-98f9-05a408c10a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:18.745046 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecca6f-f0d6-4c1d-98f9-05a408c10a1d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:18.747175 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1424/2854] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:54:18.751216 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea54bf-6605-4f76-b4d0-8e0409b8e332 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:18.761728 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea54bf-6605-4f76-b4d0-8e0409b8e332 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:18.766717 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3e392-c4b0-4bb0-ab1f-8e4736116e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:18.767419 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3e392-c4b0-4bb0-ab1f-8e4736116e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.767706 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3e392-c4b0-4bb0-ab1f-8e4736116e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.768042 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3e392-c4b0-4bb0-ab1f-8e4736116e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.768800 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3e392-c4b0-4bb0-ab1f-8e4736116e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:18.770393 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f3e392-c4b0-4bb0-ab1f-8e4736116e7d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:18.781435 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1431/2855] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:54:18.785501 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecca6f-f0d6-4c1d-98f9-05a408c10a1d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:18.795434 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecca6f-f0d6-4c1d-98f9-05a408c10a1d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:18.800187 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca270c04-54a4-4daa-bbd8-2d69cb35e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:18.801099 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca270c04-54a4-4daa-bbd8-2d69cb35e705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.801384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca270c04-54a4-4daa-bbd8-2d69cb35e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.801662 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca270c04-54a4-4daa-bbd8-2d69cb35e705 admin admin] PATH_INFO: `/v3/projects/8a27e8e5d6514b4bbaf246c8b70379a0/users/8f913ad17b5841e780a599699a294f9b/roles/67691f718ae34424ae84912841aee8df` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.816768 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca270c04-54a4-4daa-bbd8-2d69cb35e705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a27e8e5d6514b4bbaf246c8b70379a0, user_id=8f913ad17b5841e780a599699a294f9b, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:18.819517 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca270c04-54a4-4daa-bbd8-2d69cb35e705 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:18.902729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1425/2856] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:54:18 2022] PUT /identity/v3/projects/8a27e8e5d6514b4bbaf246c8b70379a0/users/8f913ad17b5841e780a599699a294f9b/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:18.913633 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af718b-93c4-49c1-bdec-9fa67dfe553d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:18.913923 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af718b-93c4-49c1-bdec-9fa67dfe553d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:18.914204 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af718b-93c4-49c1-bdec-9fa67dfe553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:18.942512 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-57af718b-93c4-49c1-bdec-9fa67dfe553d None None] MFA Rules not processed for user `8f913ad17b5841e780a599699a294f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:18.943740 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-57af718b-93c4-49c1-bdec-9fa67dfe553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:19.011116 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1432/2857] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:19.022468 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca270c04-54a4-4daa-bbd8-2d69cb35e705 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:19.024228 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ca270c04-54a4-4daa-bbd8-2d69cb35e705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:19.038242 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:19.086059 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca270c04-54a4-4daa-bbd8-2d69cb35e705 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:19.089853 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7a944-502b-479d-9545-ae522e7d8c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:19.090932 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7a944-502b-479d-9545-ae522e7d8c7c service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:19.091216 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7a944-502b-479d-9545-ae522e7d8c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:19.091497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7a944-502b-479d-9545-ae522e7d8c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:19.100577 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7a944-502b-479d-9545-ae522e7d8c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:19.102029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7a944-502b-479d-9545-ae522e7d8c7c service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:19.111710 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1426/2858] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:19.926926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af718b-93c4-49c1-bdec-9fa67dfe553d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:19.928337 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-57af718b-93c4-49c1-bdec-9fa67dfe553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:19.959535 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:19.985021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af718b-93c4-49c1-bdec-9fa67dfe553d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:19.988671 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133317-1b2f-4998-8ece-02701cced254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:19.989317 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133317-1b2f-4998-8ece-02701cced254 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:19.989599 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133317-1b2f-4998-8ece-02701cced254 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:19.989875 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82133317-1b2f-4998-8ece-02701cced254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:19.991704 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-82133317-1b2f-4998-8ece-02701cced254 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:20.053975 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82133317-1b2f-4998-8ece-02701cced254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:20.055455 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82133317-1b2f-4998-8ece-02701cced254 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:20.065894 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1433/2859] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:27.358939 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7a944-502b-479d-9545-ae522e7d8c7c service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:27.360365 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6ea7a944-502b-479d-9545-ae522e7d8c7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:27.375729 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7a944-502b-479d-9545-ae522e7d8c7c service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:27.380505 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:27.381376 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:27.381660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:27.381943 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] PATH_INFO: `/v3/users/1d89d6e107ef46008c12eeeeb36688c5` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:27.383165 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d89d6e107ef46008c12eeeeb36688c5)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:27.385210 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:27.571667 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d89d6e107ef46008c12eeeeb36688c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:27.572478 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d89d6e107ef46008c12eeeeb36688c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:27.587014 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d89d6e107ef46008c12eeeeb36688c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:27.595490 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d89d6e107ef46008c12eeeeb36688c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:27.678168 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d89d6e107ef46008c12eeeeb36688c5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:27.684685 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1427/2860] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:27 2022] DELETE /identity/v3/users/1d89d6e107ef46008c12eeeeb36688c5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:27.977044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133317-1b2f-4998-8ece-02701cced254 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:27.987180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82133317-1b2f-4998-8ece-02701cced254 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:28.045138 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:28.046000 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:28.046286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:28.046589 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] PATH_INFO: `/v3/projects/e0862c77c1cf4966900fcdd395840c7d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:28.047793 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0862c77c1cf4966900fcdd395840c7d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:28.049694 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:28.211600 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0862c77c1cf4966900fcdd395840c7d', 'request_id': 'req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.335539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0862c77c1cf4966900fcdd395840c7d', 'request_id': 'req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.341964 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0862c77c1cf4966900fcdd395840c7d', 'request_id': 'req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.352930 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] The token cache is being invalidate because project e0862c77c1cf4966900fcdd395840c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:28.353646 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.354252 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.355821 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1434/2861] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:27 2022] DELETE /identity/v3/projects/e0862c77c1cf4966900fcdd395840c7d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:54:28.359931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:28.361333 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:28.375383 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7280d401-70b1-4b78-aad1-b306b1e01669 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:28.434007 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:28.434921 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:28.435209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:28.435488 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] PATH_INFO: `/v3/users/524e3049088e49efbaf46ef548631eca` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:28.436799 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] RBAC: Authorizing `identity:delete_user(user_id=524e3049088e49efbaf46ef548631eca)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:28.438761 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:28.643960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:28.657191 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '524e3049088e49efbaf46ef548631eca'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.657849 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '524e3049088e49efbaf46ef548631eca'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.670011 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '524e3049088e49efbaf46ef548631eca'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.676671 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '524e3049088e49efbaf46ef548631eca'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.768131 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '524e3049088e49efbaf46ef548631eca'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:28.774317 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1428/2862] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:28 2022] DELETE /identity/v3/users/524e3049088e49efbaf46ef548631eca => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:29.049609 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:29.051249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:29.064516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d887f8-8ea5-4fcf-92cd-3e44295f0c9e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:29.068358 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:29.120650 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:29.121516 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:29.121803 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:29.122084 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] PATH_INFO: `/v3/projects/f4a8b3c567d14bb6bd7271081b960105` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:29.123331 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a8b3c567d14bb6bd7271081b960105)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:29.125249 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:29.293492 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a8b3c567d14bb6bd7271081b960105', 'request_id': 'req-3cd566f7-b43a-4054-b0e4-7be95583a973'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:29.364444 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a8b3c567d14bb6bd7271081b960105', 'request_id': 'req-3cd566f7-b43a-4054-b0e4-7be95583a973'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:29.370284 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a8b3c567d14bb6bd7271081b960105', 'request_id': 'req-3cd566f7-b43a-4054-b0e4-7be95583a973'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:29.382351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] The token cache is being invalidate because project f4a8b3c567d14bb6bd7271081b960105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:29.382805 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:29.386748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3cd566f7-b43a-4054-b0e4-7be95583a973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:29.386748 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1435/2863] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:29 2022] DELETE /identity/v3/projects/f4a8b3c567d14bb6bd7271081b960105 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:35.291344 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:35.292820 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:35.305805 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16cb07-c273-458c-b8ee-a009797dc98b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:35.361362 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:35.362229 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:35.362515 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:35.362794 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] PATH_INFO: `/v3/users/8f913ad17b5841e780a599699a294f9b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:35.364008 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f913ad17b5841e780a599699a294f9b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:35.365923 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:35.548439 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f913ad17b5841e780a599699a294f9b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:35.551405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f913ad17b5841e780a599699a294f9b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:35.561035 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f913ad17b5841e780a599699a294f9b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:35.567933 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f913ad17b5841e780a599699a294f9b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:35.655359 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f913ad17b5841e780a599699a294f9b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:35.661937 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1429/2864] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:35 2022] DELETE /identity/v3/users/8f913ad17b5841e780a599699a294f9b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:54:35.666420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe8a6c-b202-4ca2-b9b6-22a245f44e5d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:35.666941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe8a6c-b202-4ca2-b9b6-22a245f44e5d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:35.667044 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe8a6c-b202-4ca2-b9b6-22a245f44e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:35.685566 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6efe8a6c-b202-4ca2-b9b6-22a245f44e5d None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:35.686757 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6efe8a6c-b202-4ca2-b9b6-22a245f44e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:35.746416 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1436/2865] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:35.755962 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:35.757357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:35.789051 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:35.815312 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5430c1-ca2f-4163-ae8e-0fb3b455604d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:35.818893 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5f5f4-5bd6-40b5-94ad-54ccdf889dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:35.820672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f5f4-5bd6-40b5-94ad-54ccdf889dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:35.820672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f5f4-5bd6-40b5-94ad-54ccdf889dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:35.820672 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5f5f4-5bd6-40b5-94ad-54ccdf889dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:35.831152 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5f5f4-5bd6-40b5-94ad-54ccdf889dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:35.832872 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5f5f4-5bd6-40b5-94ad-54ccdf889dc3 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:35.843518 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1430/2866] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:36.370529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe8a6c-b202-4ca2-b9b6-22a245f44e5d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:36.372110 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6efe8a6c-b202-4ca2-b9b6-22a245f44e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:36.385313 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe8a6c-b202-4ca2-b9b6-22a245f44e5d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:36.389967 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:36.390865 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:36.391158 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:36.391441 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] PATH_INFO: `/v3/projects/8a27e8e5d6514b4bbaf246c8b70379a0` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:36.392926 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a27e8e5d6514b4bbaf246c8b70379a0)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:36.394883 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:36.553155 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:36.564978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a27e8e5d6514b4bbaf246c8b70379a0', 'request_id': 'req-743c5f7e-4129-494a-b296-87fba14c40da'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:36.667292 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a27e8e5d6514b4bbaf246c8b70379a0', 'request_id': 'req-743c5f7e-4129-494a-b296-87fba14c40da'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:36.673480 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a27e8e5d6514b4bbaf246c8b70379a0', 'request_id': 'req-743c5f7e-4129-494a-b296-87fba14c40da'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:36.684997 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] The token cache is being invalidate because project 8a27e8e5d6514b4bbaf246c8b70379a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:36.685286 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:36.685936 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-743c5f7e-4129-494a-b296-87fba14c40da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:36.687624 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1437/2867] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:36 2022] DELETE /identity/v3/projects/8a27e8e5d6514b4bbaf246c8b70379a0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:36.692523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063afe02-dd69-4448-a4cb-dbc11cff85ec None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:36.697057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063afe02-dd69-4448-a4cb-dbc11cff85ec None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:36.697057 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063afe02-dd69-4448-a4cb-dbc11cff85ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:36.710652 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-063afe02-dd69-4448-a4cb-dbc11cff85ec None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:36.711900 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-063afe02-dd69-4448-a4cb-dbc11cff85ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:36.774647 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1431/2868] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:36.783021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75750cb-70ef-4225-9630-33526a616a4e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:36.783311 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75750cb-70ef-4225-9630-33526a616a4e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:36.783583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75750cb-70ef-4225-9630-33526a616a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:36.801545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c75750cb-70ef-4225-9630-33526a616a4e None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:36.802733 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c75750cb-70ef-4225-9630-33526a616a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:36.810719 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1438/2869] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:36.814762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063afe02-dd69-4448-a4cb-dbc11cff85ec None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:36.825209 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063afe02-dd69-4448-a4cb-dbc11cff85ec None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:36.829806 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d056f9-d4f5-438e-9026-9b2965e6bf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:36.830460 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d056f9-d4f5-438e-9026-9b2965e6bf42 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:36.830745 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d056f9-d4f5-438e-9026-9b2965e6bf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:36.831062 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d056f9-d4f5-438e-9026-9b2965e6bf42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:36.831793 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d056f9-d4f5-438e-9026-9b2965e6bf42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:54:36.832101 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d056f9-d4f5-438e-9026-9b2965e6bf42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:36.833762 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d056f9-d4f5-438e-9026-9b2965e6bf42 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:36.846192 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1432/2870] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:54:36.850488 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75750cb-70ef-4225-9630-33526a616a4e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:36.860529 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75750cb-70ef-4225-9630-33526a616a4e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:36.865188 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c151b-a97a-494c-9e7d-d66efc0cc6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:36.865836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c151b-a97a-494c-9e7d-d66efc0cc6ff admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:36.866119 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c151b-a97a-494c-9e7d-d66efc0cc6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:36.866429 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c151b-a97a-494c-9e7d-d66efc0cc6ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:36.867146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c151b-a97a-494c-9e7d-d66efc0cc6ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:36.870205 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c151b-a97a-494c-9e7d-d66efc0cc6ff admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:36.981405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1439/2871] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:54:36 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:36.985457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d056f9-d4f5-438e-9026-9b2965e6bf42 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:36.996325 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d056f9-d4f5-438e-9026-9b2965e6bf42 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:37.051890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d902-8f6b-40c1-82fd-66adb0c0ce62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:37.054020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d902-8f6b-40c1-82fd-66adb0c0ce62 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:37.054020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d902-8f6b-40c1-82fd-66adb0c0ce62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:37.054020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0d902-8f6b-40c1-82fd-66adb0c0ce62 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:37.054020 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0d902-8f6b-40c1-82fd-66adb0c0ce62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:37.055708 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0d902-8f6b-40c1-82fd-66adb0c0ce62 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:37.152357 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1433/2872] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:54:36 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:37.156558 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c151b-a97a-494c-9e7d-d66efc0cc6ff admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:37.167758 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c151b-a97a-494c-9e7d-d66efc0cc6ff admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:37.178681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d15f8b-c136-4cbf-8e2f-b5a5813130df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:37.178681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d15f8b-c136-4cbf-8e2f-b5a5813130df admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:37.178681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d15f8b-c136-4cbf-8e2f-b5a5813130df admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:37.178681 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d15f8b-c136-4cbf-8e2f-b5a5813130df admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:37.179099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d15f8b-c136-4cbf-8e2f-b5a5813130df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:37.179099 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d15f8b-c136-4cbf-8e2f-b5a5813130df admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:37.186422 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1440/2873] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:37.190655 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d902-8f6b-40c1-82fd-66adb0c0ce62 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:37.201267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0d902-8f6b-40c1-82fd-66adb0c0ce62 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:37.205927 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92550274-c77a-417c-96b1-5671112b97c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:37.206582 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92550274-c77a-417c-96b1-5671112b97c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:37.206890 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92550274-c77a-417c-96b1-5671112b97c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:37.207172 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92550274-c77a-417c-96b1-5671112b97c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:37.207895 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92550274-c77a-417c-96b1-5671112b97c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:37.209649 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92550274-c77a-417c-96b1-5671112b97c5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:37.220996 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1434/2874] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:37.227778 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d15f8b-c136-4cbf-8e2f-b5a5813130df admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:37.238197 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d15f8b-c136-4cbf-8e2f-b5a5813130df admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:37.242754 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a67ea-75de-4fe5-bad0-7955ed3a4cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:37.243818 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a67ea-75de-4fe5-bad0-7955ed3a4cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:37.244021 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a67ea-75de-4fe5-bad0-7955ed3a4cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:37.244278 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a67ea-75de-4fe5-bad0-7955ed3a4cb2 admin admin] PATH_INFO: `/v3/projects/2f9bcef43bd949f3b61e9007ac917626/users/baa34164c5f64f6287910c952b9179cb/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:37.258550 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a67ea-75de-4fe5-bad0-7955ed3a4cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9bcef43bd949f3b61e9007ac917626, user_id=baa34164c5f64f6287910c952b9179cb, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:37.262392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a67ea-75de-4fe5-bad0-7955ed3a4cb2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:37.330092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1441/2875] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:54:37 2022] PUT /identity/v3/projects/2f9bcef43bd949f3b61e9007ac917626/users/baa34164c5f64f6287910c952b9179cb/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:37.341495 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf7219-e5ec-4734-9423-41f2ea5d01d9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:37.341785 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf7219-e5ec-4734-9423-41f2ea5d01d9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:37.342067 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf7219-e5ec-4734-9423-41f2ea5d01d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:37.368879 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e8bf7219-e5ec-4734-9423-41f2ea5d01d9 None None] MFA Rules not processed for user `baa34164c5f64f6287910c952b9179cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:37.370122 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e8bf7219-e5ec-4734-9423-41f2ea5d01d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:37.393391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:37.433780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1435/2876] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:37.444545 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a67ea-75de-4fe5-bad0-7955ed3a4cb2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:37.446387 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-354a67ea-75de-4fe5-bad0-7955ed3a4cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:37.502940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a67ea-75de-4fe5-bad0-7955ed3a4cb2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:37.506521 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad475c3c-99c3-47be-b176-6f3dbeab4164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee91a24eb66d4753bc6a81d278b1088f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:37.507224 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad475c3c-99c3-47be-b176-6f3dbeab4164 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:37.507539 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad475c3c-99c3-47be-b176-6f3dbeab4164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:37.507985 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad475c3c-99c3-47be-b176-6f3dbeab4164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:37.517785 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad475c3c-99c3-47be-b176-6f3dbeab4164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:37.519315 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad475c3c-99c3-47be-b176-6f3dbeab4164 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:37.528979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1442/2877] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:41.773430 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf7219-e5ec-4734-9423-41f2ea5d01d9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:41.833479 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf7219-e5ec-4734-9423-41f2ea5d01d9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:41.842140 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:41.843160 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:41.847143 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:41.847402 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] PATH_INFO: `/v3/users/baa34164c5f64f6287910c952b9179cb` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:41.848836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa34164c5f64f6287910c952b9179cb)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:41.850879 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:42.099211 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa34164c5f64f6287910c952b9179cb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.099823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa34164c5f64f6287910c952b9179cb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.113055 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa34164c5f64f6287910c952b9179cb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.120915 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa34164c5f64f6287910c952b9179cb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.185193 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa34164c5f64f6287910c952b9179cb'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.191739 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1436/2878] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:54:41 2022] DELETE /identity/v3/users/baa34164c5f64f6287910c952b9179cb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:42.196405 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cccd27-425a-4527-8e7f-49b294e6f354 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:42.196882 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cccd27-425a-4527-8e7f-49b294e6f354 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:42.197010 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cccd27-425a-4527-8e7f-49b294e6f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:42.213979 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b8cccd27-425a-4527-8e7f-49b294e6f354 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:42.215312 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b8cccd27-425a-4527-8e7f-49b294e6f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:42.265999 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:42.274464 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1443/2879] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:42.284523 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:42.285959 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:42.333484 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:42.344270 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a41b8-aa7c-4da7-9b83-a3c4bfff9a2e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:42.347848 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053367e-4da1-4e2c-abef-5390857d8833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:42.348494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053367e-4da1-4e2c-abef-5390857d8833 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:42.348780 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053367e-4da1-4e2c-abef-5390857d8833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:42.349058 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053367e-4da1-4e2c-abef-5390857d8833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:42.358735 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053367e-4da1-4e2c-abef-5390857d8833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:42.360138 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053367e-4da1-4e2c-abef-5390857d8833 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:42.371134 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1437/2880] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:42.799487 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cccd27-425a-4527-8e7f-49b294e6f354 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:42.800995 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b8cccd27-425a-4527-8e7f-49b294e6f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:42.814372 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cccd27-425a-4527-8e7f-49b294e6f354 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:42.819755 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:42.820656 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:42.820920 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:42.821202 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] PATH_INFO: `/v3/projects/2f9bcef43bd949f3b61e9007ac917626` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:42.823180 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9bcef43bd949f3b61e9007ac917626)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:42.825250 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:42.918723 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9bcef43bd949f3b61e9007ac917626', 'request_id': 'req-5197b1b7-90cd-4502-8e41-2ef400abc09b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.979212 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9bcef43bd949f3b61e9007ac917626', 'request_id': 'req-5197b1b7-90cd-4502-8e41-2ef400abc09b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.985076 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9bcef43bd949f3b61e9007ac917626', 'request_id': 'req-5197b1b7-90cd-4502-8e41-2ef400abc09b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.997068 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] The token cache is being invalidate because project 2f9bcef43bd949f3b61e9007ac917626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:54:42.997365 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.998066 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5197b1b7-90cd-4502-8e41-2ef400abc09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:54:42.999687 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1444/2881] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:54:42 2022] DELETE /identity/v3/projects/2f9bcef43bd949f3b61e9007ac917626 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:43.004736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cce4d-61a9-42ff-be68-b4da676e710c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.005174 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cce4d-61a9-42ff-be68-b4da676e710c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.005426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cce4d-61a9-42ff-be68-b4da676e710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.023773 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9c2cce4d-61a9-42ff-be68-b4da676e710c None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:43.025644 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9c2cce4d-61a9-42ff-be68-b4da676e710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:43.085199 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1438/2882] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:43.149233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc13f0-b306-40c0-876e-945f38a24a15 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.149583 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc13f0-b306-40c0-876e-945f38a24a15 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.150514 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc13f0-b306-40c0-876e-945f38a24a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.169268 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-26dc13f0-b306-40c0-876e-945f38a24a15 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:43.170395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-26dc13f0-b306-40c0-876e-945f38a24a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:43.178606 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1445/2883] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:43.183605 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cce4d-61a9-42ff-be68-b4da676e710c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:43.193623 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cce4d-61a9-42ff-be68-b4da676e710c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:43.198795 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3009f-64fd-4ef7-a55a-bfa17e1e882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:43.199497 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3009f-64fd-4ef7-a55a-bfa17e1e882a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.199763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3009f-64fd-4ef7-a55a-bfa17e1e882a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.200043 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3009f-64fd-4ef7-a55a-bfa17e1e882a admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.200776 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3009f-64fd-4ef7-a55a-bfa17e1e882a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:54:43.201086 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3009f-64fd-4ef7-a55a-bfa17e1e882a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:43.202680 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3009f-64fd-4ef7-a55a-bfa17e1e882a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:43.214472 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1439/2884] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 09:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:54:43.218752 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc13f0-b306-40c0-876e-945f38a24a15 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:43.228189 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc13f0-b306-40c0-876e-945f38a24a15 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:43.232736 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab16593-ad18-4b00-aacd-85506da17291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:43.233413 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab16593-ad18-4b00-aacd-85506da17291 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.233697 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab16593-ad18-4b00-aacd-85506da17291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.233977 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab16593-ad18-4b00-aacd-85506da17291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.234661 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab16593-ad18-4b00-aacd-85506da17291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:43.236598 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab16593-ad18-4b00-aacd-85506da17291 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:43.330157 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1446/2885] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 09:54:43 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:43.334405 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3009f-64fd-4ef7-a55a-bfa17e1e882a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:43.344536 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3009f-64fd-4ef7-a55a-bfa17e1e882a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:43.401419 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab17b2-74d9-4770-8aa5-cdecb1a97e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:43.402088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab17b2-74d9-4770-8aa5-cdecb1a97e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.402374 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab17b2-74d9-4770-8aa5-cdecb1a97e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.402655 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab17b2-74d9-4770-8aa5-cdecb1a97e89 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.403457 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab17b2-74d9-4770-8aa5-cdecb1a97e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:43.405426 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab17b2-74d9-4770-8aa5-cdecb1a97e89 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:43.569886 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1440/2886] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 09:54:43 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:54:43.574187 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab16593-ad18-4b00-aacd-85506da17291 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:43.584737 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab16593-ad18-4b00-aacd-85506da17291 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:43.589940 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480de1-ae08-47ef-8a65-77bb74ceda35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:43.590608 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480de1-ae08-47ef-8a65-77bb74ceda35 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.590922 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480de1-ae08-47ef-8a65-77bb74ceda35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.591382 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4480de1-ae08-47ef-8a65-77bb74ceda35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.592109 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4480de1-ae08-47ef-8a65-77bb74ceda35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:43.593732 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4480de1-ae08-47ef-8a65-77bb74ceda35 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:43.605082 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1447/2887] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:43.609305 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab17b2-74d9-4770-8aa5-cdecb1a97e89 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:43.620181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab17b2-74d9-4770-8aa5-cdecb1a97e89 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:43.624929 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551cc50d-6679-49e5-bc71-9888932e5c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:43.625597 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cc50d-6679-49e5-bc71-9888932e5c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.625883 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cc50d-6679-49e5-bc71-9888932e5c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.626186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551cc50d-6679-49e5-bc71-9888932e5c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.626953 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cc50d-6679-49e5-bc71-9888932e5c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:43.628586 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551cc50d-6679-49e5-bc71-9888932e5c24 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:43.638443 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1441/2888] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 09:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:54:43.642582 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480de1-ae08-47ef-8a65-77bb74ceda35 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:43.652374 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4480de1-ae08-47ef-8a65-77bb74ceda35 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:43.656828 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ce858-34c5-41cd-9486-d23da5549b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:43.657702 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ce858-34c5-41cd-9486-d23da5549b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.657989 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ce858-34c5-41cd-9486-d23da5549b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.658264 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ce858-34c5-41cd-9486-d23da5549b03 admin admin] PATH_INFO: `/v3/projects/430681921417437fae7c8972ec250662/users/d70705ec78e94b76a8c3d7e6654d0d17/roles/67691f718ae34424ae84912841aee8df` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.673274 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ce858-34c5-41cd-9486-d23da5549b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=430681921417437fae7c8972ec250662, user_id=d70705ec78e94b76a8c3d7e6654d0d17, role_id=67691f718ae34424ae84912841aee8df)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:43.675948 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ce858-34c5-41cd-9486-d23da5549b03 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:43.747267 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1448/2889] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 09:54:43 2022] PUT /identity/v3/projects/430681921417437fae7c8972ec250662/users/d70705ec78e94b76a8c3d7e6654d0d17/roles/67691f718ae34424ae84912841aee8df => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:54:43.756974 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc81c9-a16c-4386-8359-27de7e5136e8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.757267 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc81c9-a16c-4386-8359-27de7e5136e8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.757546 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc81c9-a16c-4386-8359-27de7e5136e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.784353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8cdc81c9-a16c-4386-8359-27de7e5136e8 None None] MFA Rules not processed for user `d70705ec78e94b76a8c3d7e6654d0d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:54:43.785604 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8cdc81c9-a16c-4386-8359-27de7e5136e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:43.827293 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:43.849757 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1442/2890] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:54:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:54:43.863690 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ce858-34c5-41cd-9486-d23da5549b03 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:54:43.865380 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-009ce858-34c5-41cd-9486-d23da5549b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:54:43.923845 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ce858-34c5-41cd-9486-d23da5549b03 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:54:43.927482 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9062d-8ffb-4c3a-93cc-0b54fc8f858a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0a8a5a1bc174acd9b13477c7d4b4a07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:54:43.928125 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9062d-8ffb-4c3a-93cc-0b54fc8f858a service glance] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:54:43.928417 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9062d-8ffb-4c3a-93cc-0b54fc8f858a service glance] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:54:43.928701 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9062d-8ffb-4c3a-93cc-0b54fc8f858a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:54:43.937083 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9062d-8ffb-4c3a-93cc-0b54fc8f858a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:54:43.938504 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9062d-8ffb-4c3a-93cc-0b54fc8f858a service glance] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:54:43.947407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1449/2891] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:54:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:53.887702 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=8 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:53.943273 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:10.885843 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc81c9-a16c-4386-8359-27de7e5136e8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:55:10.946823 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc81c9-a16c-4386-8359-27de7e5136e8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:55:10.951771 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:55:10.952641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:10.952925 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:10.953201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] PATH_INFO: `/v3/users/d70705ec78e94b76a8c3d7e6654d0d17` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:10.954384 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d70705ec78e94b76a8c3d7e6654d0d17)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:55:10.956353 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:55:11.205029 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd70705ec78e94b76a8c3d7e6654d0d17'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:11.205641 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd70705ec78e94b76a8c3d7e6654d0d17'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:11.218328 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd70705ec78e94b76a8c3d7e6654d0d17'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:11.225201 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd70705ec78e94b76a8c3d7e6654d0d17'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:11.324386 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd70705ec78e94b76a8c3d7e6654d0d17'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:11.330400 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1443/2892] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:55:10 2022] DELETE /identity/v3/users/d70705ec78e94b76a8c3d7e6654d0d17 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:55:11.334961 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14c9f-06d5-4c28-84a8-60b50b56c428 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:11.335420 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14c9f-06d5-4c28-84a8-60b50b56c428 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:11.335532 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14c9f-06d5-4c28-84a8-60b50b56c428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:11.352777 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0fe14c9f-06d5-4c28-84a8-60b50b56c428 None None] MFA Rules not processed for user `f8e5b4d849064820a77929db188df50b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:55:11.353978 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0fe14c9f-06d5-4c28-84a8-60b50b56c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:55:11.412668 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1450/2893] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 09:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:55:11.428668 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:55:11.430112 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:55:11.487736 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b9aff-fb54-488d-91f9-9599e02a9190 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:55:11.491253 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7677cea-9a05-479d-8151-9d879534f6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b2db60c511f4fd29b772ca5fb014d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:55:11.491894 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7677cea-9a05-479d-8151-9d879534f6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:11.492180 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7677cea-9a05-479d-8151-9d879534f6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:11.492455 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7677cea-9a05-479d-8151-9d879534f6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:11.501471 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7677cea-9a05-479d-8151-9d879534f6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:55:11.502935 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7677cea-9a05-479d-8151-9d879534f6b2 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:55:11.512779 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1444/2894] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 09:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:55:11.954801 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe14c9f-06d5-4c28-84a8-60b50b56c428 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:55:11.956301 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0fe14c9f-06d5-4c28-84a8-60b50b56c428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:55:11.968992 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe14c9f-06d5-4c28-84a8-60b50b56c428 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:55:11.973836 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:55:11.974715 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:11.975040 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:11.975324 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] PATH_INFO: `/v3/projects/430681921417437fae7c8972ec250662` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:11.976541 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=430681921417437fae7c8972ec250662)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:55:11.978557 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:55:12.159407 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430681921417437fae7c8972ec250662', 'request_id': 'req-c0e76cba-c699-4fba-bd13-9e9a9e653637'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:12.254822 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430681921417437fae7c8972ec250662', 'request_id': 'req-c0e76cba-c699-4fba-bd13-9e9a9e653637'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:12.261146 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430681921417437fae7c8972ec250662', 'request_id': 'req-c0e76cba-c699-4fba-bd13-9e9a9e653637'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:12.272409 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] The token cache is being invalidate because project 430681921417437fae7c8972ec250662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:55:12.272941 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:12.273392 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:12.274960 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1451/2895] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:55:11 2022] DELETE /identity/v3/projects/430681921417437fae7c8972ec250662 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:55:21.508084 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:22.269456 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:31.840583 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da32a9-f630-4f53-bace-31c08943fa2d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:31.841028 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da32a9-f630-4f53-bace-31c08943fa2d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:31.841171 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da32a9-f630-4f53-bace-31c08943fa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:31.858926 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d8da32a9-f630-4f53-bace-31c08943fa2d None None] MFA Rules not processed for user `2a5fd14de7794b14bd0a2a2a62a70762`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:55:31.860091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d8da32a9-f630-4f53-bace-31c08943fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:55:31.914161 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1445/2896] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 09:55:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:55:31.956555 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:55:31.957987 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:55:32.027935 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e76cba-c699-4fba-bd13-9e9a9e653637 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:55:32.032856 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b894a5-7c4f-4598-adef-1f90d54cf357 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25606976e6fe4daf9a552368088cdef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:55:32.033501 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b894a5-7c4f-4598-adef-1f90d54cf357 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:32.033784 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b894a5-7c4f-4598-adef-1f90d54cf357 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:32.034092 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b894a5-7c4f-4598-adef-1f90d54cf357 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:32.042028 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b894a5-7c4f-4598-adef-1f90d54cf357 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:55:32.043994 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b894a5-7c4f-4598-adef-1f90d54cf357 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:55:32.051949 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1452/2897] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 09:55:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:55:39.963898 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da32a9-f630-4f53-bace-31c08943fa2d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:55:39.966212 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d8da32a9-f630-4f53-bace-31c08943fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:55:40.033826 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da32a9-f630-4f53-bace-31c08943fa2d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:55:40.038424 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:55:40.039331 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:40.039614 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:40.039960 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] PATH_INFO: `/v3/users/a86dc6c4e7ce49c393a2e8ae6a1c34d3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:40.041079 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86dc6c4e7ce49c393a2e8ae6a1c34d3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:55:40.043243 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:55:40.228494 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86dc6c4e7ce49c393a2e8ae6a1c34d3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.229091 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86dc6c4e7ce49c393a2e8ae6a1c34d3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.241213 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86dc6c4e7ce49c393a2e8ae6a1c34d3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.249703 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86dc6c4e7ce49c393a2e8ae6a1c34d3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.340931 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86dc6c4e7ce49c393a2e8ae6a1c34d3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.347255 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1446/2898] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:55:39 2022] DELETE /identity/v3/users/a86dc6c4e7ce49c393a2e8ae6a1c34d3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:55:40.599864 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b894a5-7c4f-4598-adef-1f90d54cf357 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:55:40.613233 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b894a5-7c4f-4598-adef-1f90d54cf357 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:55:40.675351 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:55:40.676262 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:40.676552 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:40.676842 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] PATH_INFO: `/v3/projects/73eb3009629e4ddcab335bcf40b97782` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:40.678056 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=73eb3009629e4ddcab335bcf40b97782)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:55:40.680062 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:55:40.786657 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73eb3009629e4ddcab335bcf40b97782', 'request_id': 'req-21511819-87e6-4015-90a5-34adfe1d7ebc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.869339 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73eb3009629e4ddcab335bcf40b97782', 'request_id': 'req-21511819-87e6-4015-90a5-34adfe1d7ebc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.875334 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73eb3009629e4ddcab335bcf40b97782', 'request_id': 'req-21511819-87e6-4015-90a5-34adfe1d7ebc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.886170 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] The token cache is being invalidate because project 73eb3009629e4ddcab335bcf40b97782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:55:40.886458 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.887143 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:40.888686 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1453/2899] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:55:40 2022] DELETE /identity/v3/projects/73eb3009629e4ddcab335bcf40b97782 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:55:40.892908 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:55:40.894300 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:55:40.908341 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915bf17-c23a-47ad-b42d-ca0a75de2cdb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:55:40.928775 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:40.965885 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:55:40.966777 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:40.967088 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:40.967391 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] PATH_INFO: `/v3/users/f51099a21c5b432d8cb8a878339ecf5b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:40.968660 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51099a21c5b432d8cb8a878339ecf5b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:55:40.970553 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:55:41.191395 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51099a21c5b432d8cb8a878339ecf5b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.191964 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51099a21c5b432d8cb8a878339ecf5b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.204334 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51099a21c5b432d8cb8a878339ecf5b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.211078 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51099a21c5b432d8cb8a878339ecf5b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.303473 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51099a21c5b432d8cb8a878339ecf5b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.309774 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1447/2900] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 09:55:40 2022] DELETE /identity/v3/users/f51099a21c5b432d8cb8a878339ecf5b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:55:41.551038 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:55:41.552474 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:55:41.566285 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21511819-87e6-4015-90a5-34adfe1d7ebc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:55:41.587847 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:41.627162 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8e5b4d849064820a77929db188df50b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecfbe47b81cd4fe29763116c4e6fcb19', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:55:41.631802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:55:41.631802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:55:41.631802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] PATH_INFO: `/v3/projects/e95b8cabd55948fb832674ac1a408638` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:55:41.631802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95b8cabd55948fb832674ac1a408638)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:55:41.631802 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:55:41.757747 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95b8cabd55948fb832674ac1a408638', 'request_id': 'req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.826590 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95b8cabd55948fb832674ac1a408638', 'request_id': 'req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.832446 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95b8cabd55948fb832674ac1a408638', 'request_id': 'req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.844105 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] The token cache is being invalidate because project e95b8cabd55948fb832674ac1a408638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:55:41.844395 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.845027 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7fc050d4-434f-41b6-8fec-a8b0e3bfaa38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:55:41.846569 dv-cinder-803823-13-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1454/2901] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 09:55:41 2022] DELETE /identity/v3/projects/e95b8cabd55948fb832674ac1a408638 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:55:51.305999 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:51.841141 dv-cinder-803823-13-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:00:14.449181 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 10:00:14.450570 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:00:14.590836 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5377736-025d-4ae9-8ddc-b4fbdc4f03ae admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 10:00:14.648791 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d240b7-4370-4f73-bedc-b3fa858b7ffe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87fd5580ed264a08a3ad31850e0a53a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ec77816151b45228e087023588839da', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 10:00:14.649438 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d240b7-4370-4f73-bedc-b3fa858b7ffe service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 10:00:14.649722 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d240b7-4370-4f73-bedc-b3fa858b7ffe service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 10:00:14.650000 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d240b7-4370-4f73-bedc-b3fa858b7ffe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 10:00:14.651763 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-59d240b7-4370-4f73-bedc-b3fa858b7ffe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 10:00:14.663574 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d240b7-4370-4f73-bedc-b3fa858b7ffe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 10:00:14.670231 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d240b7-4370-4f73-bedc-b3fa858b7ffe service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 10:00:14.675186 dv-cinder-803823-13-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1448/2902] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 10:00:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 10:00:24.670704 dv-cinder-803823-13-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}